Oct 31 07:27:22.907228 ip-10-0-128-20 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 07:27:23.335936 ip-10-0-128-20 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:27:23.335936 ip-10-0-128-20 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 07:27:23.335936 ip-10-0-128-20 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:27:23.335936 ip-10-0-128-20 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:27:23.341610 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341527    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:27:23.341610 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341608    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:27:23.341610 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341612    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341616    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341620    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341623    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341626    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341629    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341632    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341635    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341639    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341644    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341653    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341657    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341660    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341663    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341666    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341668    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341671    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341674    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341677    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:27:23.341713 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341680    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341682    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341685    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341687    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341690    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341693    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341695    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341698    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341702    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341706    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341709    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341713    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341716    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341719    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341722    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341725    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341727    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341730    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341732    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:27:23.342171 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341735    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341738    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341740    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341743    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341746    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341749    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341752    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341755    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341757    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341759    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341762    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341765    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341767    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341770    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341773    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341776    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341779    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341781    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341783    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341786    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:27:23.342617 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341789    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341791    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341794    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341796    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341799    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341801    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341804    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341806    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341809    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341812    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341815    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341817    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341820    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341822    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341825    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341827    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341830    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341832    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341835    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:27:23.343102 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341838    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341841    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341843    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341846    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341848    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341851    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341854    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341856    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341860    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341863    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341866    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341868    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341871    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341874    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341876    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341878    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341881    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341884    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341886    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341889    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:27:23.343548 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341891    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341894    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341896    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341899    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341901    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341904    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.341906    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342682    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342688    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342691    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342694    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342697    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342700    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342703    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342706    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342709    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342711    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342715    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342718    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:27:23.344023 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342721    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342724    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342726    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342729    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342732    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342735    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342737    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342740    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342742    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342745    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342748    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342750    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342753    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342755    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342758    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342760    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342763    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342765    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342768    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342770    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:27:23.344513 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342773    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342777    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342781    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342784    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342787    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342789    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342793    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342796    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342799    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342801    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342804    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342807    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342809    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342812    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342815    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342817    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342819    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342822    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342825    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:27:23.345003 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342827    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342830    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342833    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342835    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342838    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342841    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342843    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342846    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342849    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342851    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342854    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342856    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342859    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342862    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342864    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342867    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342869    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342871    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342875    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342877    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:27:23.345457 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342880    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342883    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342885    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342888    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342890    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342893    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342896    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342899    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342902    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342904    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342906    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342909    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342927    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342930    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342934    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342938    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342940    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342944    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342946    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:27:23.345933 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342949    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342951    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342954    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342956    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342959    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342962    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342964    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342967    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342970    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342973    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342975    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342978    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342981    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342983    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342986    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.342989    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343535    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343541    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343545    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343548    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:27:23.346392 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343551    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343554    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343556    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343559    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343562    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343565    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343568    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343571    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343574    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343577    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343580    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343583    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343585    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343588    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343591    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343593    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343596    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343599    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343601    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343603    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:27:23.346859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343606    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343609    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343611    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343614    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343616    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343619    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343622    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343624    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343628    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343631    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343633    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343635    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343638    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343640    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343643    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343646    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343648    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343651    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343655    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:27:23.347351 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343659    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343663    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343665    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343668    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343671    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343674    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343676    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343678    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343681    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343683    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343686    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343688    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343690    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343693    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343695    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343698    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343701    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343703    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343705    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:27:23.347877 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343708    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343711    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343714    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343717    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343719    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343722    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343724    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343727    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343729    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343732    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343734    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343736    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343742    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343744    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343747    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343749    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343753    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343756    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343759    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:27:23.348349 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343761    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343764    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343766    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343769    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343771    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343774    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343776    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343779    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343782    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343784    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343787    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343789    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343791    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343795    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343798    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343801    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343803    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343805    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343808    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343811    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:27:23.348792 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343813    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343816    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343818    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343821    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.343823    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343932    2575 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343946    2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343955    2575 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343960    2575 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343965    2575 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343969    2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343973    2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343977    2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343980    2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343983    2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343986    2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343989    2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343992    2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343995    2575 flags.go:64] FLAG: --cgroup-root=""
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.343998    2575 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344001    2575 flags.go:64] FLAG: --client-ca-file=""
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344004    2575 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344007    2575 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344010    2575 flags.go:64] FLAG: --cluster-domain=""
Oct 31 07:27:23.349324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344013    2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344016    2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344019    2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344022    2575 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344030    2575 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344033    2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344037    2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344040    2575 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344043    2575 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344046    2575 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344049    2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344053    2575 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344056    2575 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344063    2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344066    2575 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344069    2575 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344072    2575 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344075    2575 flags.go:64] FLAG: --enable-server="true"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344078    2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344083    2575 flags.go:64] FLAG: --event-burst="100"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344086    2575 flags.go:64] FLAG: --event-qps="50"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344089    2575 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344093    2575 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344096    2575 flags.go:64] FLAG: --eviction-hard=""
Oct 31 07:27:23.349902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344100    2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344103    2575 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344106    2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344109    2575 flags.go:64] FLAG: --eviction-soft=""
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344112    2575 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344115    2575 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344118    2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344121    2575 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344124    2575 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344127    2575 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344130    2575 flags.go:64] FLAG: --feature-gates=""
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344134    2575 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344137    2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344141    2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344144    2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344147    2575 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344150    2575 flags.go:64] FLAG: --help="false"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344153    2575 flags.go:64] FLAG: --hostname-override="ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344156    2575 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344159    2575 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344162    2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344170    2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344173    2575 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344176    2575 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 07:27:23.350501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344179    2575 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344182    2575 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344185    2575 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344188    2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344191    2575 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344194    2575 flags.go:64] FLAG: --kube-reserved=""
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344197    2575 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344200    2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344203    2575 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344206    2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344209    2575 flags.go:64] FLAG: --lock-file=""
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344212    2575 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344215    2575 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344218    2575 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344223    2575 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344226    2575 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344230    2575 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344233    2575 flags.go:64] FLAG: --logging-format="text"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344235    2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344239    2575 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344242    2575 flags.go:64] FLAG: --manifest-url=""
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344245    2575 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344250    2575 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344253    2575 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344257    2575 flags.go:64] FLAG: --max-pods="110"
Oct 31 07:27:23.351086 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344260    2575 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344264    2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344266    2575 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344269    2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344274    2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344278    2575 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344280    2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344288    2575 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344291    2575 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344294    2575 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344297    2575 flags.go:64] FLAG: --pod-cidr=""
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344301    2575 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344304    2575 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344307    2575 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344309    2575 flags.go:64] FLAG: --port="10250"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344313    2575 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344316    2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa70f34d871de152"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344319    2575 flags.go:64] FLAG: --qos-reserved=""
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344322    2575 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344325    2575 flags.go:64] FLAG: --register-node="true"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344328    2575 flags.go:64] FLAG: --register-with-taints=""
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344332    2575 flags.go:64] FLAG: --registry-burst="10"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344336    2575 flags.go:64] FLAG: --registry-qps="5"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344338    2575 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344341    2575 flags.go:64] FLAG: --reserved-memory=""
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344345    2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 07:27:23.351884 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344348    2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344351    2575 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344354    2575 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344357    2575 flags.go:64] FLAG: --runonce="false"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344361    2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344364    2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344368    2575 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344370    2575 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344373    2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344376    2575 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344382    2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344385    2575 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344388    2575 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344391    2575 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344394    2575 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344396    2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344400    2575 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344402    2575 flags.go:64] FLAG: --system-cgroups=""
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344405    2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344410    2575 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344413    2575 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344416    2575 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344419    2575 flags.go:64] FLAG: --tls-min-version=""
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344422    2575 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344425    2575 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 07:27:23.352761 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344428    2575 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344431    2575 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344434    2575 flags.go:64] FLAG: --v="2"
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344438    2575 flags.go:64] FLAG: --version="false"
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344443    2575 flags.go:64] FLAG: --vmodule=""
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344446    2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344449    2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344592    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344596    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344599    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344601    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344604    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344607    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344610    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344612    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344615    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344618    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344623    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344626    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344628    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344631    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344634    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:27:23.353385 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344636    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344639    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344641    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344644    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344647    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344649    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344652    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344654    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344657    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344659    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344662    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344664    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344667    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344669    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344672    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344674    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344677    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344680    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344683    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344685    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:27:23.353932 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344688    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344690    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344693    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344697    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344701    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344704    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344708    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344712    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344715    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344718    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344721    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344723    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344726    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344729    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344731    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344734    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344736    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344739    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344742    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:27:23.354407 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344744    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344747    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344750    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344752    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344755    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344758    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344760    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344763    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344765    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344768    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344770    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344773    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344775    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344778    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344780    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344783    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344785    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344788    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344791    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:27:23.354859 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344794    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344800    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344802    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344805    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344807    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344810    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344812    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344815    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344818    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344822    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344825    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344828    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344831    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344833    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344836    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344839    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344841    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344844    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344847    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:27:23.355316 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344849    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344852    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344855    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344857    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344860    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344863    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344865    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344868    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344870    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344873    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344875    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344877    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344880    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344883    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.344924    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344962    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:27:23.355752 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344966    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344969    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344971    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344974    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344976    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344979    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344982    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344985    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344987    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344991    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344993    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344996    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.344999    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345002    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345004    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345007    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345010    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345013    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345017    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:27:23.356148 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345020    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345024    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345027    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345030    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345033    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345036    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345038    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345041    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345043    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345046    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345049    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345053    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345056    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345058    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345061    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345063    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345066    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345068    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345071    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345073    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:27:23.356589 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345076    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345078    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345080    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345083    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345086    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345088    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345091    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345093    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345096    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345098    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345101    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345103    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345106    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345108    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345111    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345113    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345116    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345119    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345121    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345123    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:27:23.357179 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345126    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345128    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345131    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345134    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345137    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345139    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345142    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345144    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345147    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345149    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345152    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345154    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345157    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345159    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345162    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345164    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345167    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345170    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345173    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345175    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:27:23.357647 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345178    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345182    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345185    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345188    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345191    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345193    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345196    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345198    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345200    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345203    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345205    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345208    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345210    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345213    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345216    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345218    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345222    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345224    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:27:23.358115 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345227    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345229    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345232    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345235    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345237    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345240    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345244    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.345246    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.353775    2575 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.353793    2575 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.354637    2575 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.354644    2575 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354709    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354715    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354719    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354722    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354726    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354729    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354732    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354734    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:27:23.358598 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354737    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354740    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354743    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354745    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354748    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354750    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354753    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354755    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354758    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354761    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354764    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354766    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354769    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354771    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354780    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354783    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354786    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354789    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354792    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354794    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:27:23.359093 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354797    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354801    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354803    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354806    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354809    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354812    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354815    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354817    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354820    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354822    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354825    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354827    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354830    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354833    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354835    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354838    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354841    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354843    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354852    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:27:23.359566 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354855    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354857    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354860    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354863    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354866    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354868    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354871    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354874    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354877    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354879    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354882    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354885    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354887    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354890    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354893    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354895    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354898    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354901    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354903    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:27:23.360029 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354906    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354909    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354922    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354926    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354930    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354934    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354937    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354940    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354942    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354945    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354947    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354952    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354956    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354965    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354968    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354972    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354974    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354977    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354979    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:27:23.360462 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354982    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354985    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354987    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354990    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354993    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354995    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.354998    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355000    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355003    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355006    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355008    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355011    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355015    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355018    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355021    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355023    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355026    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355029    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355031    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355034    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:27:23.360902 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355036    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.355066    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355215    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355220    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355223    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355225    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355228    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355232    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355234    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355237    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355239    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355242    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355246    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355248    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355251    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355254    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:27:23.361465 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355257    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355260    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355263    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355265    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355268    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355270    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355273    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355276    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355279    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355282    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355284    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355287    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355290    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355292    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355295    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355297    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355300    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355302    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355305    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355307    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:27:23.361870 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355310    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355312    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355315    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355318    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355321    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355324    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355327    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355330    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355332    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355335    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355338    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355341    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355343    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355346    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355348    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355351    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355353    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355356    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355359    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:27:23.362334 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355361    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355364    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355366    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355369    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355372    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355379    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355382    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355384    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355387    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355390    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355392    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355395    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355397    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355400    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355403    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355405    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355408    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355411    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355414    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:27:23.362767 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355418    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355422    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355425    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355428    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355431    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355434    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355437    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355440    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355443    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355445    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355448    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355450    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355453    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355455    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355458    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355460    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355464    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355468    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355473    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355475    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:27:23.363215 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355478    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355480    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355483    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355486    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355488    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355490    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355493    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355496    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355498    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355501    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355503    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355506    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355509    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355512    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.355537    2575 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355569    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:27:23.363681 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355573    2575 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355576    2575 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355580    2575 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355582    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355585    2575 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355587    2575 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355590    2575 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355593    2575 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355595    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355598    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355600    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355603    2575 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355606    2575 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355608    2575 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355613    2575 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355616    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355618    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355621    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355623    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355626    2575 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:27:23.364081 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355628    2575 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355631    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355633    2575 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355636    2575 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355638    2575 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355641    2575 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355644    2575 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355646    2575 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355649    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355652    2575 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355655    2575 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355657    2575 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355660    2575 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355663    2575 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355665    2575 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355668    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355671    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355673    2575 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355676    2575 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:27:23.364552 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355678    2575 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355682    2575 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355684    2575 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355687    2575 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355689    2575 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355692    2575 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355694    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355701    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355703    2575 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355706    2575 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355709    2575 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355711    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355714    2575 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355717    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355719    2575 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355722    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355725    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355728    2575 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355730    2575 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:27:23.365126 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355733    2575 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355735    2575 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355739    2575 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355742    2575 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355746    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355749    2575 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355751    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355754    2575 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355757    2575 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355760    2575 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355762    2575 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355765    2575 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355768    2575 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355770    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355773    2575 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355775    2575 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355778    2575 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355780    2575 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355784    2575 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:27:23.365584 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355787    2575 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355793    2575 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355795    2575 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355798    2575 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355800    2575 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355803    2575 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355805    2575 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355808    2575 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355811    2575 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355814    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355816    2575 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355819    2575 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355823    2575 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355826    2575 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355828    2575 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355831    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355833    2575 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355836    2575 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355839    2575 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355841    2575 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:27:23.366073 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355844    2575 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355846    2575 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355849    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355851    2575 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355854    2575 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355856    2575 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355859    2575 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:23.355861    2575 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.355939    2575 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.358351    2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.359417    2575 server.go:1014] "Starting client certificate rotation"
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.359511    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.359550    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.361711    2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 07:27:23.366709 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.364739    2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 07:27:23.372611 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.372591    2575 log.go:25] "Validated CRI v1 runtime API"
Oct 31 07:27:23.376556 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.376541    2575 log.go:25] "Validated CRI v1 image API"
Oct 31 07:27:23.377391 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.377365    2575 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 07:27:23.381216 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.381190    2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b477b2ee-eeae-4abf-90c3-c9391bb3ecda:/dev/nvme0n1p3 eb8ed6a1-fd26-48ee-bb7b-279f852bcf7b:/dev/nvme0n1p4]
Oct 31 07:27:23.381295 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.381214    2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 31 07:27:23.387561 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.387122    2575 manager.go:217] Machine: {Timestamp:2026-10-31 07:27:23.385544859 +0000 UTC m=+0.373687390 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2955524 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec265a6e6dca8a058ac1af5b87fd955b SystemUUID:ec265a6e-6dca-8a05-8ac1-af5b87fd955b BootID:2a06822d-cb2c-4e73-96e6-87d48ca1ab8a Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d1:84:c7:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d1:84:c7:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:79:1a:8c:87:92 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 07:27:23.388462 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.388435    2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 07:27:23.388764 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.388732    2575 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 07:27:23.392104 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.392071    2575 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 07:27:23.392264 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.392105    2575 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-20.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 07:27:23.392960 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.392947    2575 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 07:27:23.393014 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.392964    2575 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 07:27:23.393014 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.393008    2575 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 07:27:23.393100 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.393030    2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 07:27:23.394248 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.394234    2575 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 07:27:23.398782 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.398767    2575 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 07:27:23.398947 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.398936    2575 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 07:27:23.399742 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.399732    2575 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 07:27:23.399805 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.399751    2575 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 07:27:23.399805 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.399767    2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 07:27:23.399805 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.399781    2575 kubelet.go:405] "Adding apiserver pod source"
Oct 31 07:27:23.399805 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.399794    2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 07:27:23.400223 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.400209    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 07:27:23.402647 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.402632    2575 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 07:27:23.409241 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.409226    2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 07:27:23.410149 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.410136    2575 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 07:27:23.410200 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.410167    2575 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 07:27:23.410324 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.410313    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 07:27:23.410358 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.410331    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 07:27:23.410358 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.410337    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 07:27:23.410358 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.410342    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 07:27:23.410358 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.410348    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 07:27:23.410457 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.410367    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 07:27:23.411013 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.411004    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 07:27:23.411048 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.411014    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 07:27:23.411048 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.411030    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 07:27:23.411048 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.411036    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 07:27:23.411048 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.411044    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 07:27:23.411167 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.411053    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 07:27:23.411824 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.411815    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 07:27:23.411824 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.411824    2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 07:27:23.415850 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.415837    2575 server.go:1263] "Started kubelet"
Oct 31 07:27:23.415986 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.415958    2575 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 07:27:23.416212 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.415948    2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 07:27:23.416284 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.416229    2575 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 07:27:23.416706 ip-10-0-128-20 systemd[1]: Started Kubernetes Kubelet.
Oct 31 07:27:23.417812 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.417793    2575 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 07:27:23.420407 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.420088    2575 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 07:27:23.422898 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.422879    2575 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 31 07:27:23.424648 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.424634    2575 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 07:27:23.424706 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.424650    2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 07:27:23.424769 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.424728    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:23.425379 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.425363    2575 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 07:27:23.425472 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.425383    2575 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 07:27:23.425472 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.425369    2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 07:27:23.425577 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.425519    2575 factory.go:55] Registering systemd factory
Oct 31 07:27:23.425577 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.425535    2575 factory.go:223] Registration of the systemd container factory successfully
Oct 31 07:27:23.425577 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.425550    2575 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 07:27:23.425577 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.425558    2575 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 07:27:23.426006 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.425987    2575 factory.go:153] Registering CRI-O factory
Oct 31 07:27:23.426111 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.426021    2575 factory.go:223] Registration of the crio container factory successfully
Oct 31 07:27:23.426174 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.426162    2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 07:27:23.426217 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.426181    2575 factory.go:103] Registering Raw factory
Oct 31 07:27:23.426217 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.426213    2575 manager.go:1199] Started watching for new ooms in manager
Oct 31 07:27:23.427350 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.427336    2575 manager.go:319] Starting recovery of all containers
Oct 31 07:27:23.439470 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.439446    2575 manager.go:324] Recovery completed
Oct 31 07:27:23.443705 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.443691    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:27:23.445775 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.445746    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 07:27:23.445843 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.445790    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 07:27:23.445843 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.445802    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientPID"
Oct 31 07:27:23.446328 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.446312    2575 cpu_manager.go:226] "Starting" policy="none"
Oct 31 07:27:23.446328 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.446325    2575 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 07:27:23.446443 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.446345    2575 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 07:27:23.446991 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.446973    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:27:23.448587 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.448572    2575 policy_none.go:50] "Start"
Oct 31 07:27:23.448637 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.448593    2575 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 07:27:23.448637 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.448609    2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 07:27:23.448955 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.448928    2575 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-20.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Oct 31 07:27:23.450133 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.448948    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-20.ec2.internal.18e38c93e2be9052  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-20.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-20.ec2.internal,},FirstTimestamp:2026-10-31 07:27:23.41581013 +0000 UTC m=+0.403952661,LastTimestamp:2026-10-31 07:27:23.41581013 +0000 UTC m=+0.403952661,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-20.ec2.internal,}"
Oct 31 07:27:23.450617 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.450600    2575 policy_none.go:44] "Start"
Oct 31 07:27:23.450773 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.450760    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 07:27:23.450821 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.450785    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 07:27:23.450821 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.450795    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientPID"
Oct 31 07:27:23.456333 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.456310    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 07:27:23.460666 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.460647    2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-20.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 31 07:27:23.467598 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.467500    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-20.ec2.internal.18e38c93e487c5ce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-20.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-20.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-20.ec2.internal,},FirstTimestamp:2026-10-31 07:27:23.445773774 +0000 UTC m=+0.433916305,LastTimestamp:2026-10-31 07:27:23.445773774 +0000 UTC m=+0.433916305,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-20.ec2.internal,}"
Oct 31 07:27:23.468323 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.468270    2575 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 31 07:27:23.468323 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.468273    2575 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Oct 31 07:27:23.468468 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.468313    2575 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-20.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 31 07:27:23.470115 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.470093    2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7h2cf"
Oct 31 07:27:23.478180 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.478165    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7h2cf"
Oct 31 07:27:23.481594 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.481554    2575 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.486631    2575 manager.go:341] "Starting Device Plugin manager"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.487271    2575 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.487289    2575 server.go:87] "Starting device plugin registration server"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.487528    2575 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.487538    2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.487701    2575 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.487759    2575 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.487765    2575 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.488237    2575 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.488298    2575 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.491146    2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-20.ec2.internal.18e38c93e4881eb3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-20.ec2.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-20.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-20.ec2.internal,},FirstTimestamp:2026-10-31 07:27:23.445796531 +0000 UTC m=+0.433939062,LastTimestamp:2026-10-31 07:27:23.445796531 +0000 UTC m=+0.433939062,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-20.ec2.internal,}"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.502831    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.504267    2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.504291    2575 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.504314    2575 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 07:27:23.508649 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.504349    2575 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 31 07:27:23.520561 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.520542    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:27:23.588679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.588571    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:27:23.589627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.589608    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 07:27:23.589715 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.589638    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 07:27:23.589715 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.589651    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientPID"
Oct 31 07:27:23.589715 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.589675    2575 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.605251 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.605231    2575 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"]
Oct 31 07:27:23.605332 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.605286    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:27:23.606147 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.606130    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 07:27:23.606254 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.606163    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 07:27:23.606254 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.606178    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientPID"
Oct 31 07:27:23.608325 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.608308    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:27:23.608477 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.608463    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.608520 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.608497    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:27:23.608982 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.608960    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 07:27:23.609079 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.608996    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 07:27:23.609079 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.609006    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 07:27:23.609079 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.609024    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 07:27:23.609079 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.609033    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientPID"
Oct 31 07:27:23.609079 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.609009    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientPID"
Oct 31 07:27:23.611025 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.611010    2575 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.611095 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.611030    2575 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-20.ec2.internal\": node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:23.611181 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.611165    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.611217 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.611202    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:27:23.611900 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.611884    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 07:27:23.611987 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.611929    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 07:27:23.611987 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.611943    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientPID"
Oct 31 07:27:23.626810 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.626788    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7ef466d4952ee7684f323b6e3eda034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-20.ec2.internal\" (UID: \"e7ef466d4952ee7684f323b6e3eda034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.626895 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.626814    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.626895 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.626831    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.645451 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.645433    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-20.ec2.internal\" not found" node="ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.647333 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.647315    2575 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-20.ec2.internal\" not found" node="ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.656797 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.656779    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:23.727169 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.727140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.727169 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.727172    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.727366 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.727188    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7ef466d4952ee7684f323b6e3eda034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-20.ec2.internal\" (UID: \"e7ef466d4952ee7684f323b6e3eda034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.727366 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.727220    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7ef466d4952ee7684f323b6e3eda034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-20.ec2.internal\" (UID: \"e7ef466d4952ee7684f323b6e3eda034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.727366 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.727236    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.727366 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.727251    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.757808 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.757776    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:23.858312 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.858231    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:23.949937 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.949879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.953038 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:23.953011    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:23.958473 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:23.958328    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.059220 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.059179    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.159819 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.159749    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.260305 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.260266    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.358715 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.358685    2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 31 07:27:24.359233 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.358832    2575 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 07:27:24.361040 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.361012    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.458867 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.458800    2575 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:27:24.461099 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.461080    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.486409 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.486381    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 07:22:24 +0000 UTC" deadline="2028-05-04 04:32:10.38494144 +0000 UTC"
Oct 31 07:27:24.486469 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.486409    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13221h4m45.89853527s"
Oct 31 07:27:24.493236 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:24.493207    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8023f9bb6bcb2bf36bd9213cfe9f546d.slice/crio-d48935d7e4d6b565b145e60988db297a1639ea3ef86ec35e0f2135190f35dffa WatchSource:0}: Error finding container d48935d7e4d6b565b145e60988db297a1639ea3ef86ec35e0f2135190f35dffa: Status 404 returned error can't find the container with id d48935d7e4d6b565b145e60988db297a1639ea3ef86ec35e0f2135190f35dffa
Oct 31 07:27:24.493658 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:24.493639    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ef466d4952ee7684f323b6e3eda034.slice/crio-b9d6d79758591128284893b48d027583ff81a05dd4af58a8120f9e196dcbc98a WatchSource:0}: Error finding container b9d6d79758591128284893b48d027583ff81a05dd4af58a8120f9e196dcbc98a: Status 404 returned error can't find the container with id b9d6d79758591128284893b48d027583ff81a05dd4af58a8120f9e196dcbc98a
Oct 31 07:27:24.498709 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.498689    2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 07:27:24.508354 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.508315    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal" event={"ID":"8023f9bb6bcb2bf36bd9213cfe9f546d","Type":"ContainerStarted","Data":"d48935d7e4d6b565b145e60988db297a1639ea3ef86ec35e0f2135190f35dffa"}
Oct 31 07:27:24.509522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.509497    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal" event={"ID":"e7ef466d4952ee7684f323b6e3eda034","Type":"ContainerStarted","Data":"b9d6d79758591128284893b48d027583ff81a05dd4af58a8120f9e196dcbc98a"}
Oct 31 07:27:24.562083 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.562053    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.600722 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.600671    2575 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:27:24.601875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.601859    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 07:27:24.601966 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.601889    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 07:27:24.601966 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.601906    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientPID"
Oct 31 07:27:24.662633 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.662599    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.763595 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.763510    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.864461 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.864416    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.965377 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:24.965331    2575 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:27:24.988431 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:24.988404    2575 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:27:25.025602 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.025522    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:25.049788 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.049759    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:27:25.051004 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.050972    2575 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:27:25.075130 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.075091    2575 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:27:25.376220 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.376092    2575 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:27:25.400293 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.400265    2575 apiserver.go:52] "Watching apiserver"
Oct 31 07:27:25.426271 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.426246    2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 31 07:27:25.446364 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.446344    2575 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 07:27:25.446756 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.446735    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-6ktj5","openshift-multus/network-metrics-daemon-fkcpf","kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal","openshift-cluster-node-tuning-operator/tuned-xmjdj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal","kube-system/konnectivity-agent-kwmnp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms","openshift-network-operator/iptables-alerter-jm95s","openshift-ovn-kubernetes/ovnkube-node-kqq5l","kube-system/global-pull-secret-syncer-qpskk","openshift-dns/node-resolver-hzt8h","openshift-image-registry/node-ca-8498p","openshift-multus/multus-j9f7v","openshift-network-diagnostics/network-check-target-mtrsf"]
Oct 31 07:27:25.449781 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.449758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.451930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.451891    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.454348 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.454325    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:25.454445 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.454407    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:25.457644 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.457623    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.459894 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.459875    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.462309 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.462288    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:25.465653 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.465633    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.468723 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.468701    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.470887 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.470869    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 07:27:25.471043 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.470888    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 07:27:25.471538 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.471514    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n7m4f\""
Oct 31 07:27:25.471829 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.471812    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 07:27:25.471930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.471917    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xtmc6\""
Oct 31 07:27:25.472275 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.472249    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 07:27:25.472607 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.472592    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 07:27:25.472847 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.472828    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:25.472948 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.472911    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:25.476661 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.475810    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:25.476661 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.475885    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:25.478250 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.478225    2575 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 07:27:25.478372 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.478312    2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r7vql"
Oct 31 07:27:25.478937 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.478906    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.484380 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.484364    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.527462 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.527440    2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 07:27:25.530222 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.530178    2575 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:27:25.538871 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.538847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/408136c3-732d-4564-a1f8-c969888f361d-hosts-file\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.539004 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.538872    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-kubelet\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539004 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.538899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-config\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539004 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.538943    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsx85\" (UniqueName: \"kubernetes.io/projected/508a0686-e4c7-472a-b608-d270a7dbce3d-kube-api-access-nsx85\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.539004 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.538972    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.539004 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.538994    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.539247 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539054    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4820d461-a6e0-49fe-a57c-dbff7bc255f8-host-slash\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.539247 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539070    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539247 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539091    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.539247 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539136    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-kubernetes\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.539247 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539154    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.539247 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539176    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-systemd\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.539247 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539216    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-daemon-config\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.539247 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539233    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24qkk\" (UniqueName: \"kubernetes.io/projected/408136c3-732d-4564-a1f8-c969888f361d-kube-api-access-24qkk\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539254    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-systemd-units\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539300    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-slash\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539327    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-agent-certs\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-k8s-cni-cncf-io\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539362    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-bin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539381    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrth6\" (UniqueName: \"kubernetes.io/projected/f2d1eb29-7f18-41ee-949d-33892c4b30c1-kube-api-access-vrth6\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539412    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-socket-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539426    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-systemd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539447    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539497    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-script-lib\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539514    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-lib-modules\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539571    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539593    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539609    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539626    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-conf\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539641    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539656    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-kubelet-config\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539672    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539687    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-socket-dir-parent\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539709    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-etc-kubernetes\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539724    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrmzs\" (UniqueName: \"kubernetes.io/projected/06e7dac1-d91c-4928-bbca-a4d1535e2170-kube-api-access-lrmzs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539739    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxr9\" (UniqueName: \"kubernetes.io/projected/4820d461-a6e0-49fe-a57c-dbff7bc255f8-kube-api-access-mrxr9\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539757    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-etc-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539772    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-ovn\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539791    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovn-node-metrics-cert\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539806    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-cnibin\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.539930 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539820    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-sys\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539836    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-tuned\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539851    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-system-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539867    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-registration-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539883    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-sys-fs\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539897    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-dbus\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.539913    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-cni-binary-copy\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540043    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-multus\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540074    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-conf-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540138    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-var-lib-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbnpr\" (UniqueName: \"kubernetes.io/projected/a2320145-3aab-44be-a1c2-7912c2498c30-kube-api-access-sbnpr\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540241    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540286    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540313    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysconfig\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540346    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-netns\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540393    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vg8q5\" (UniqueName: \"kubernetes.io/projected/513eea23-470d-4236-ae17-1666a54ce63f-kube-api-access-vg8q5\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.540704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540432    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408136c3-732d-4564-a1f8-c969888f361d-tmp-dir\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540482    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-bin\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540524    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2d1eb29-7f18-41ee-949d-33892c4b30c1-serviceca\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540565    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-var-lib-kubelet\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540616    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4vtt\" (UniqueName: \"kubernetes.io/projected/29654c5b-afac-4935-b729-3e5b5c8adf50-kube-api-access-g4vtt\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540678    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2d1eb29-7f18-41ee-949d-33892c4b30c1-host\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540793    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4820d461-a6e0-49fe-a57c-dbff7bc255f8-iptables-alerter-script\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540823    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7775h\" (UniqueName: \"kubernetes.io/projected/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-kube-api-access-7775h\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540847    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-system-cni-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540863    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-run\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540906    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-tmp\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540947    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-node-log\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.540985    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-env-overrides\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541009    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-multus-certs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541059    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-device-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541093    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-netns\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.541290 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541151    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-log-socket\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.541963 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541209    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-modprobe-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.541963 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541242    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-host\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.541963 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541280    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-konnectivity-ca\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:25.541963 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541315    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-cnibin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.541963 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541366    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-kubelet\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.541963 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541408    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-netd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.541963 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.541453    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-hostroot\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.584638 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.584607    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 07:27:25.585135 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585109    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:27:25.585276 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585254    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 07:27:25.585363 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585295    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 07:27:25.585518 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585495    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-vgg5g\""
Oct 31 07:27:25.585652 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585592    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 07:27:25.585652 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585629    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 07:27:25.585758 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585650    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 07:27:25.585758 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585704    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-xhs6v\""
Oct 31 07:27:25.585758 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585710    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6ssn\""
Oct 31 07:27:25.585758 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585748    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 07:27:25.585901 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585809    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gjb5j\""
Oct 31 07:27:25.585901 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585846    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 07:27:25.585901 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585861    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 07:27:25.585901 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.585881    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:27:25.586185 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.586167    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 07:27:25.586293 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.586215    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p7l5b\""
Oct 31 07:27:25.586293 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.586234    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 07:27:25.586293 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.586259    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 07:27:25.586293 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.586285    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 07:27:25.586493 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.586324    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 07:27:25.586493 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.586393    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 07:27:25.586493 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.586449    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 07:27:25.586631 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.586502    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 07:27:25.598674 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.598652    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 07:27:25.599522 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.599482    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 07:27:25.600001 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.599981    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hgtls\""
Oct 31 07:27:25.600001 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.599988    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fh9bq\""
Oct 31 07:27:25.600159 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.600024    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 07:27:25.642144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642058    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.642144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642095    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.642144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642114    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-kubernetes\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.642144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642130    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642192    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-systemd\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-daemon-config\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642267    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24qkk\" (UniqueName: \"kubernetes.io/projected/408136c3-732d-4564-a1f8-c969888f361d-kube-api-access-24qkk\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642294    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-systemd-units\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642298    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642304    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-kubernetes\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642357    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-systemd\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642364    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-slash\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642399    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-systemd-units\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642203    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-slash\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642451    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-agent-certs\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:25.642479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642475    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-k8s-cni-cncf-io\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642513    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-bin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642540    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrth6\" (UniqueName: \"kubernetes.io/projected/f2d1eb29-7f18-41ee-949d-33892c4b30c1-kube-api-access-vrth6\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-socket-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-systemd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642614    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-script-lib\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642647    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-lib-modules\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642694    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642711    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642726    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-conf\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642742    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642766    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-kubelet-config\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642785    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642801    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-socket-dir-parent\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.643178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642804    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-k8s-cni-cncf-io\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642825    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-etc-kubernetes\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.642822    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-bin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.642929    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643009    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-systemd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.643032    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs podName:a2320145-3aab-44be-a1c2-7912c2498c30 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:26.142976658 +0000 UTC m=+3.131119196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs") pod "network-metrics-daemon-fkcpf" (UID: "a2320145-3aab-44be-a1c2-7912c2498c30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643063    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643109    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-kubelet-config\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643163    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-conf\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643194    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrmzs\" (UniqueName: \"kubernetes.io/projected/06e7dac1-d91c-4928-bbca-a4d1535e2170-kube-api-access-lrmzs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643249    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxr9\" (UniqueName: \"kubernetes.io/projected/4820d461-a6e0-49fe-a57c-dbff7bc255f8-kube-api-access-mrxr9\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643280    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-etc-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643307    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-ovn\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643334    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovn-node-metrics-cert\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643342    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643360    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-cnibin\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643381    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-lib-modules\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.644122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643010    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643443    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-sys\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-sys\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643467    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-socket-dir-parent\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643489    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-tuned\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643533    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-etc-kubernetes\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643564    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-system-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643592    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-registration-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643616    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-sys-fs\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643635    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-dbus\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643656    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-cni-binary-copy\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643661    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-system-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643682    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-multus\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643705    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-conf-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643707    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-ovn\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643721    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-var-lib-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643741    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-etc-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643741    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbnpr\" (UniqueName: \"kubernetes.io/projected/a2320145-3aab-44be-a1c2-7912c2498c30-kube-api-access-sbnpr\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:25.645007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643778    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-registration-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643783    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643832    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-sys-fs\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643833    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643866    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysconfig\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643897    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-netns\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643927    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg8q5\" (UniqueName: \"kubernetes.io/projected/513eea23-470d-4236-ae17-1666a54ce63f-kube-api-access-vg8q5\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643944    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-dbus\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.643953    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408136c3-732d-4564-a1f8-c969888f361d-tmp-dir\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644001    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-bin\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644028    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2d1eb29-7f18-41ee-949d-33892c4b30c1-serviceca\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644056    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-var-lib-kubelet\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644082    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4vtt\" (UniqueName: \"kubernetes.io/projected/29654c5b-afac-4935-b729-3e5b5c8adf50-kube-api-access-g4vtt\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644107    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2d1eb29-7f18-41ee-949d-33892c4b30c1-host\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644133    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4820d461-a6e0-49fe-a57c-dbff7bc255f8-iptables-alerter-script\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644150    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644159    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7775h\" (UniqueName: \"kubernetes.io/projected/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-kube-api-access-7775h\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.646005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-system-cni-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644248    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-system-cni-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644278    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-run\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644311    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-tmp\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644343    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-node-log\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644372    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-env-overrides\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.644395    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644400    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-multus-certs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644417    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-cni-binary-copy\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-device-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.644448    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret podName:21fea0a5-efb9-4b1a-b561-d173b3ad6169 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:26.144430527 +0000 UTC m=+3.132573067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret") pod "global-pull-secret-syncer-qpskk" (UID: "21fea0a5-efb9-4b1a-b561-d173b3ad6169") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644471    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-multus\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644483    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-device-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644524    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-netns\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644729    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-run\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644788    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysconfig\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644786    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408136c3-732d-4564-a1f8-c969888f361d-tmp-dir\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644835    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-bin\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.646875 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644895    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-conf-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644937    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-socket-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644962    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-var-lib-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644974    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-daemon-config\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645008    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-node-log\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.644313    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-cnibin\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645037    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645183    2575 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645251    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-multus-certs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645343    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2d1eb29-7f18-41ee-949d-33892c4b30c1-serviceca\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645429    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-netns\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645459    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-log-socket\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645488    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-modprobe-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645505    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-netns\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645512    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-host\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645523    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4820d461-a6e0-49fe-a57c-dbff7bc255f8-iptables-alerter-script\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645548    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-konnectivity-ca\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645563    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-host\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.647679 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645582    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-cnibin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645613    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-kubelet\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645607    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-log-socket\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645642    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-netd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645666    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-hostroot\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645699    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/408136c3-732d-4564-a1f8-c969888f361d-hosts-file\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645714    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-modprobe-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645724    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-kubelet\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645752    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-config\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645760    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-kubelet\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645779    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsx85\" (UniqueName: \"kubernetes.io/projected/508a0686-e4c7-472a-b608-d270a7dbce3d-kube-api-access-nsx85\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645807    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645832    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645859    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4820d461-a6e0-49fe-a57c-dbff7bc255f8-host-slash\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645944    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4820d461-a6e0-49fe-a57c-dbff7bc255f8-host-slash\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.645992    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-netd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646018    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2d1eb29-7f18-41ee-949d-33892c4b30c1-host\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646051    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-hostroot\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.648404 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646070    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-konnectivity-ca\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646081    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-cnibin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646092    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/408136c3-732d-4564-a1f8-c969888f361d-hosts-file\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646134    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-var-lib-kubelet\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646140    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-kubelet\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646208    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646301    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646826    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.646886    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.647255    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-env-overrides\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.647350    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-script-lib\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.649144 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.647662    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-config\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.652314 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.652287    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-tmp\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.652414 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.652310    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-tuned\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.652414 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.652368    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovn-node-metrics-cert\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.652484 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.652468    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-agent-certs\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:25.664270 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.664243    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrth6\" (UniqueName: \"kubernetes.io/projected/f2d1eb29-7f18-41ee-949d-33892c4b30c1-kube-api-access-vrth6\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.664635 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.664586    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24qkk\" (UniqueName: \"kubernetes.io/projected/408136c3-732d-4564-a1f8-c969888f361d-kube-api-access-24qkk\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.665015 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.664968    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:27:25.665015 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.664989    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:27:25.665015 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.665002    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dq2z7 for pod openshift-network-diagnostics/network-check-target-mtrsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:25.665231 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:25.665061    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7 podName:647db033-e901-4100-b8a0-a60948730917 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:26.165044909 +0000 UTC m=+3.153187451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dq2z7" (UniqueName: "kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7") pod "network-check-target-mtrsf" (UID: "647db033-e901-4100-b8a0-a60948730917") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:25.668304 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.668276    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrmzs\" (UniqueName: \"kubernetes.io/projected/06e7dac1-d91c-4928-bbca-a4d1535e2170-kube-api-access-lrmzs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.673298 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.673268    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxr9\" (UniqueName: \"kubernetes.io/projected/4820d461-a6e0-49fe-a57c-dbff7bc255f8-kube-api-access-mrxr9\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.673665 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.673638    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7775h\" (UniqueName: \"kubernetes.io/projected/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-kube-api-access-7775h\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.673775 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.673752    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4vtt\" (UniqueName: \"kubernetes.io/projected/29654c5b-afac-4935-b729-3e5b5c8adf50-kube-api-access-g4vtt\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.673843 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.673785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbnpr\" (UniqueName: \"kubernetes.io/projected/a2320145-3aab-44be-a1c2-7912c2498c30-kube-api-access-sbnpr\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:25.676637 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.674079    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsx85\" (UniqueName: \"kubernetes.io/projected/508a0686-e4c7-472a-b608-d270a7dbce3d-kube-api-access-nsx85\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.676637 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.675068    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg8q5\" (UniqueName: \"kubernetes.io/projected/513eea23-470d-4236-ae17-1666a54ce63f-kube-api-access-vg8q5\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.771558 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.771524    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:27:25.774109 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.774083    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:27:25.787312 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.787266    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:27:25.788281 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:25.788247    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513eea23_470d_4236_ae17_1666a54ce63f.slice/crio-08b9f307ff09d585a8d221810ce84a6fb2c2fe8b386d59ff55086576e5db9ae2 WatchSource:0}: Error finding container 08b9f307ff09d585a8d221810ce84a6fb2c2fe8b386d59ff55086576e5db9ae2: Status 404 returned error can't find the container with id 08b9f307ff09d585a8d221810ce84a6fb2c2fe8b386d59ff55086576e5db9ae2
Oct 31 07:27:25.789235 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:25.789205    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408136c3_732d_4564_a1f8_c969888f361d.slice/crio-c091275e6be81bd30a74f28e7de057b145f8e7be78d03bb64fe99292c565b4ee WatchSource:0}: Error finding container c091275e6be81bd30a74f28e7de057b145f8e7be78d03bb64fe99292c565b4ee: Status 404 returned error can't find the container with id c091275e6be81bd30a74f28e7de057b145f8e7be78d03bb64fe99292c565b4ee
Oct 31 07:27:25.796285 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.792998    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:27:25.799001 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:25.798972    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29654c5b_afac_4935_b729_3e5b5c8adf50.slice/crio-91d06bead3ca9f1adb4e87f45cb16d08250ebca22301e40541b2dd6073d9f3ff WatchSource:0}: Error finding container 91d06bead3ca9f1adb4e87f45cb16d08250ebca22301e40541b2dd6073d9f3ff: Status 404 returned error can't find the container with id 91d06bead3ca9f1adb4e87f45cb16d08250ebca22301e40541b2dd6073d9f3ff
Oct 31 07:27:25.801014 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.800989    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:25.805259 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:25.805225    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4820d461_a6e0_49fe_a57c_dbff7bc255f8.slice/crio-a6ef01d3e3777e37ed95d0089348f8ee457f4c6345bd089d16c72dbfc3f0f6a2 WatchSource:0}: Error finding container a6ef01d3e3777e37ed95d0089348f8ee457f4c6345bd089d16c72dbfc3f0f6a2: Status 404 returned error can't find the container with id a6ef01d3e3777e37ed95d0089348f8ee457f4c6345bd089d16c72dbfc3f0f6a2
Oct 31 07:27:25.813581 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:25.813552    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d4b049_ebbe_4c4f_b792_d74110bc6ec0.slice/crio-93fbf2f3d9d06aeef147be5d9729517950f9ef4d107aa8023aaa58497e470f98 WatchSource:0}: Error finding container 93fbf2f3d9d06aeef147be5d9729517950f9ef4d107aa8023aaa58497e470f98: Status 404 returned error can't find the container with id 93fbf2f3d9d06aeef147be5d9729517950f9ef4d107aa8023aaa58497e470f98
Oct 31 07:27:25.823286 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.823253    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j9f7v"
Oct 31 07:27:25.828075 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.827859    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:25.837137 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:25.837096    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e7dac1_d91c_4928_bbca_a4d1535e2170.slice/crio-537c42ce1bf48532262d5c2d266a88d8b3caefa21ae68011c71bbdff8b8e146b WatchSource:0}: Error finding container 537c42ce1bf48532262d5c2d266a88d8b3caefa21ae68011c71bbdff8b8e146b: Status 404 returned error can't find the container with id 537c42ce1bf48532262d5c2d266a88d8b3caefa21ae68011c71bbdff8b8e146b
Oct 31 07:27:25.839212 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.839180    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:27:25.841044 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:25.840963    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abc95d3_4c67_4a79_a0c2_5cdb7d2fd265.slice/crio-300dbf94145c0562b44cc2e4dacd91cd5d4e6537f17608eaa5fadcf843a3ed79 WatchSource:0}: Error finding container 300dbf94145c0562b44cc2e4dacd91cd5d4e6537f17608eaa5fadcf843a3ed79: Status 404 returned error can't find the container with id 300dbf94145c0562b44cc2e4dacd91cd5d4e6537f17608eaa5fadcf843a3ed79
Oct 31 07:27:25.846650 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:25.846496    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:27:25.850687 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:25.850555    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d1eb29_7f18_41ee_949d_33892c4b30c1.slice/crio-ca784faed0f673b74424fbbbd118c54ef9e1b28687a59cd61e1a94de3f15eb4e WatchSource:0}: Error finding container ca784faed0f673b74424fbbbd118c54ef9e1b28687a59cd61e1a94de3f15eb4e: Status 404 returned error can't find the container with id ca784faed0f673b74424fbbbd118c54ef9e1b28687a59cd61e1a94de3f15eb4e
Oct 31 07:27:25.857835 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:25.857806    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod508a0686_e4c7_472a_b608_d270a7dbce3d.slice/crio-03abbf752528aad256d10130a09b5a61f64d5aee71acc0f5363694e9dfe89d36 WatchSource:0}: Error finding container 03abbf752528aad256d10130a09b5a61f64d5aee71acc0f5363694e9dfe89d36: Status 404 returned error can't find the container with id 03abbf752528aad256d10130a09b5a61f64d5aee71acc0f5363694e9dfe89d36
Oct 31 07:27:26.149396 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.149361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:26.149589 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.149433    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:26.149589 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:26.149481    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:26.149589 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:26.149554    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs podName:a2320145-3aab-44be-a1c2-7912c2498c30 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:27.149536717 +0000 UTC m=+4.137679241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs") pod "network-metrics-daemon-fkcpf" (UID: "a2320145-3aab-44be-a1c2-7912c2498c30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:26.149589 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:26.149559    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:26.149796 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:26.149612    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret podName:21fea0a5-efb9-4b1a-b561-d173b3ad6169 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:27.149596349 +0000 UTC m=+4.137738873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret") pod "global-pull-secret-syncer-qpskk" (UID: "21fea0a5-efb9-4b1a-b561-d173b3ad6169") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:26.251054 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.250271    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:26.251054 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:26.250484    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:27:26.251054 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:26.250503    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:27:26.251054 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:26.250517    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dq2z7 for pod openshift-network-diagnostics/network-check-target-mtrsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:26.251054 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:26.250575    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7 podName:647db033-e901-4100-b8a0-a60948730917 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:27.25056142 +0000 UTC m=+4.238703955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq2z7" (UniqueName: "kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7") pod "network-check-target-mtrsf" (UID: "647db033-e901-4100-b8a0-a60948730917") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:26.482200 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.482129    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 07:22:26 +0000 UTC" deadline="2028-04-28 07:37:06.397087195 +0000 UTC"
Oct 31 07:27:26.482200 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.482198    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13080h9m39.914894182s"
Oct 31 07:27:26.530461 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.530151    2575 generic.go:356] "Generic (PLEG): container finished" podID="8023f9bb6bcb2bf36bd9213cfe9f546d" containerID="233ae652b526dcb6e257dc15519b69b938fb2e9acaeb56b4d78afb0f50dc56eb" exitCode=0
Oct 31 07:27:26.530601 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.530498    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal" event={"ID":"8023f9bb6bcb2bf36bd9213cfe9f546d","Type":"ContainerDied","Data":"233ae652b526dcb6e257dc15519b69b938fb2e9acaeb56b4d78afb0f50dc56eb"}
Oct 31 07:27:26.537004 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.536484    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal" event={"ID":"e7ef466d4952ee7684f323b6e3eda034","Type":"ContainerStarted","Data":"19fc526614fef2714db480ee0f6b00e381f0219dfa050343671bc21d55d61fb2"}
Oct 31 07:27:26.549480 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.549354    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8498p" event={"ID":"f2d1eb29-7f18-41ee-949d-33892c4b30c1","Type":"ContainerStarted","Data":"ca784faed0f673b74424fbbbd118c54ef9e1b28687a59cd61e1a94de3f15eb4e"}
Oct 31 07:27:26.559980 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.559951    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kwmnp" event={"ID":"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0","Type":"ContainerStarted","Data":"93fbf2f3d9d06aeef147be5d9729517950f9ef4d107aa8023aaa58497e470f98"}
Oct 31 07:27:26.569368 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.569288    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jm95s" event={"ID":"4820d461-a6e0-49fe-a57c-dbff7bc255f8","Type":"ContainerStarted","Data":"a6ef01d3e3777e37ed95d0089348f8ee457f4c6345bd089d16c72dbfc3f0f6a2"}
Oct 31 07:27:26.583352 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.583265    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xmjdj" event={"ID":"29654c5b-afac-4935-b729-3e5b5c8adf50","Type":"ContainerStarted","Data":"91d06bead3ca9f1adb4e87f45cb16d08250ebca22301e40541b2dd6073d9f3ff"}
Oct 31 07:27:26.589041 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.589009    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" event={"ID":"508a0686-e4c7-472a-b608-d270a7dbce3d","Type":"ContainerStarted","Data":"03abbf752528aad256d10130a09b5a61f64d5aee71acc0f5363694e9dfe89d36"}
Oct 31 07:27:26.591510 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.591425    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" event={"ID":"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265","Type":"ContainerStarted","Data":"300dbf94145c0562b44cc2e4dacd91cd5d4e6537f17608eaa5fadcf843a3ed79"}
Oct 31 07:27:26.593045 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.592993    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9f7v" event={"ID":"06e7dac1-d91c-4928-bbca-a4d1535e2170","Type":"ContainerStarted","Data":"537c42ce1bf48532262d5c2d266a88d8b3caefa21ae68011c71bbdff8b8e146b"}
Oct 31 07:27:26.623501 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.623440    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzt8h" event={"ID":"408136c3-732d-4564-a1f8-c969888f361d","Type":"ContainerStarted","Data":"c091275e6be81bd30a74f28e7de057b145f8e7be78d03bb64fe99292c565b4ee"}
Oct 31 07:27:26.657561 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:26.657527    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms" event={"ID":"513eea23-470d-4236-ae17-1666a54ce63f","Type":"ContainerStarted","Data":"08b9f307ff09d585a8d221810ce84a6fb2c2fe8b386d59ff55086576e5db9ae2"}
Oct 31 07:27:27.156696 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.156573    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:27.156696 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.156659    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:27.156921 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.156821    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:27.156921 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.156904    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret podName:21fea0a5-efb9-4b1a-b561-d173b3ad6169 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:29.156884752 +0000 UTC m=+6.145027287 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret") pod "global-pull-secret-syncer-qpskk" (UID: "21fea0a5-efb9-4b1a-b561-d173b3ad6169") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:27.157388 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.157366    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:27.157508 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.157425    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs podName:a2320145-3aab-44be-a1c2-7912c2498c30 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:29.157408889 +0000 UTC m=+6.145551424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs") pod "network-metrics-daemon-fkcpf" (UID: "a2320145-3aab-44be-a1c2-7912c2498c30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:27.257809 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.257763    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:27.258023 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.258001    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:27:27.258117 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.258035    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:27:27.258117 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.258050    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dq2z7 for pod openshift-network-diagnostics/network-check-target-mtrsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:27.258225 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.258127    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7 podName:647db033-e901-4100-b8a0-a60948730917 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:29.258106296 +0000 UTC m=+6.246248838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq2z7" (UniqueName: "kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7") pod "network-check-target-mtrsf" (UID: "647db033-e901-4100-b8a0-a60948730917") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:27.482713 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.482584    2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 07:22:26 +0000 UTC" deadline="2028-08-16 00:50:33.37218721 +0000 UTC"
Oct 31 07:27:27.482713 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.482662    2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15713h23m5.889529772s"
Oct 31 07:27:27.511303 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.511273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:27.511525 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.511317    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:27.511525 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.511422    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:27.511887 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.511858    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:27.511965 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.511931    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:27.512058 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:27.512037    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:27.696012 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.693164    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal" event={"ID":"8023f9bb6bcb2bf36bd9213cfe9f546d","Type":"ContainerStarted","Data":"a8b487ed062e8ccd2fb9dafe248d151cae8bb1ffb727cf7bdae56272ae343fd4"}
Oct 31 07:27:27.735845 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.734733    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal" podStartSLOduration=2.734710749 podStartE2EDuration="2.734710749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:26.616595026 +0000 UTC m=+3.604737571" watchObservedRunningTime="2026-10-31 07:27:27.734710749 +0000 UTC m=+4.722853293"
Oct 31 07:27:27.735845 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:27.734944    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal" podStartSLOduration=2.734937611 podStartE2EDuration="2.734937611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:27.734364364 +0000 UTC m=+4.722506928" watchObservedRunningTime="2026-10-31 07:27:27.734937611 +0000 UTC m=+4.723080156"
Oct 31 07:27:28.705424 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:28.705386    2575 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="4184bac5cac55150fc76337d87e451bb8faf5c1e67cb8ea0aa58481d655144c8" exitCode=0
Oct 31 07:27:28.705910 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:28.705527    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" event={"ID":"508a0686-e4c7-472a-b608-d270a7dbce3d","Type":"ContainerDied","Data":"4184bac5cac55150fc76337d87e451bb8faf5c1e67cb8ea0aa58481d655144c8"}
Oct 31 07:27:29.176622 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:29.176578    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:29.176802 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:29.176657    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:29.176802 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.176799    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:29.176935 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.176866    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret podName:21fea0a5-efb9-4b1a-b561-d173b3ad6169 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:33.176845713 +0000 UTC m=+10.164988252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret") pod "global-pull-secret-syncer-qpskk" (UID: "21fea0a5-efb9-4b1a-b561-d173b3ad6169") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:29.177357 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.177338    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:29.177446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.177398    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs podName:a2320145-3aab-44be-a1c2-7912c2498c30 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:33.177381073 +0000 UTC m=+10.165523609 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs") pod "network-metrics-daemon-fkcpf" (UID: "a2320145-3aab-44be-a1c2-7912c2498c30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:29.277146 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:29.277102    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:29.277343 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.277313    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:27:29.277343 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.277333    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:27:29.277463 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.277347    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dq2z7 for pod openshift-network-diagnostics/network-check-target-mtrsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:29.277463 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.277413    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7 podName:647db033-e901-4100-b8a0-a60948730917 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:33.277393743 +0000 UTC m=+10.265536270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq2z7" (UniqueName: "kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7") pod "network-check-target-mtrsf" (UID: "647db033-e901-4100-b8a0-a60948730917") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:29.506696 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:29.506166    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:29.506696 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:29.506201    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:29.506696 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.506306    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:29.506696 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.506440    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:29.506696 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:29.506514    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:29.506696 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:29.506599    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:30.723680 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:30.723650    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kwmnp" event={"ID":"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0","Type":"ContainerStarted","Data":"953b3cd28a5499bbab9609c3975c4c6b3de4cf1790ecfb9ed896da8a5800bb41"}
Oct 31 07:27:30.766814 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:30.765847    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kwmnp" podStartSLOduration=2.934478952 podStartE2EDuration="6.765825967s" totalImagesPullingTime="3.831347015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:30.765608594 +0000 UTC m=+7.753751139" watchObservedRunningTime="2026-10-31 07:27:30.765825967 +0000 UTC m=+7.753968511"
Oct 31 07:27:31.508944 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:31.508897    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:31.509119 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:31.509061    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:31.509495 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:31.509465    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:31.509607 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:31.509584    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:31.509661 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:31.509651    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:31.509760 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:31.509739    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:31.729505 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:31.729473    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8498p" event={"ID":"f2d1eb29-7f18-41ee-949d-33892c4b30c1","Type":"ContainerStarted","Data":"23003ee14fa0e83967a7c34cd1459828de7da26dc7fadaf7c288d5187d55821a"}
Oct 31 07:27:31.771855 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:31.771766    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8498p" podStartSLOduration=2.907900501 podStartE2EDuration="7.771748213s" totalImagesPullingTime="4.863847712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:31.771518586 +0000 UTC m=+8.759661409" watchObservedRunningTime="2026-10-31 07:27:31.771748213 +0000 UTC m=+8.759890758"
Oct 31 07:27:32.746510 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:32.746379    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms" event={"ID":"513eea23-470d-4236-ae17-1666a54ce63f","Type":"ContainerStarted","Data":"43b39f97b702708b0b4e9bc43c622eb4198277874c57af70f360a86aaa95846b"}
Oct 31 07:27:32.993177 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:32.992135    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:32.995594 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:32.995279    2575 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:33.214071 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.213369    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:33.214071 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.213440    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:33.214071 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.213575    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:33.214071 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.213632    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret podName:21fea0a5-efb9-4b1a-b561-d173b3ad6169 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:41.213614029 +0000 UTC m=+18.201756570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret") pod "global-pull-secret-syncer-qpskk" (UID: "21fea0a5-efb9-4b1a-b561-d173b3ad6169") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:33.214071 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.213697    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:33.214071 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.213736    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs podName:a2320145-3aab-44be-a1c2-7912c2498c30 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:41.213722071 +0000 UTC m=+18.201864605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs") pod "network-metrics-daemon-fkcpf" (UID: "a2320145-3aab-44be-a1c2-7912c2498c30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:33.313925 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.313878    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:33.314114 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.314086    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:27:33.314114 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.314107    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:27:33.314237 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.314120    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dq2z7 for pod openshift-network-diagnostics/network-check-target-mtrsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:33.314237 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.314188    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7 podName:647db033-e901-4100-b8a0-a60948730917 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:41.314169302 +0000 UTC m=+18.302311822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq2z7" (UniqueName: "kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7") pod "network-check-target-mtrsf" (UID: "647db033-e901-4100-b8a0-a60948730917") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:33.408673 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.408640    2575 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 07:27:33.492516 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.491638    2575 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T07:27:33.408663747Z","UUID":"288f5995-90f6-4c5e-9681-083edcc3f70e","Handler":null,"Name":"","Endpoint":""}
Oct 31 07:27:33.494087 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.493708    2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 07:27:33.494087 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.493733    2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 07:27:33.506068 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.505570    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:33.506068 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.505698    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:33.509185 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.506399    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:33.509185 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.506500    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:33.509185 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.506563    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:33.509185 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:33.506638    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:33.755061 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:33.754964    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms" event={"ID":"513eea23-470d-4236-ae17-1666a54ce63f","Type":"ContainerStarted","Data":"5acdb9cf3d5a00685f363640e4df70f76463e9eceed6f14beb04890ebd9ce3ac"}
Oct 31 07:27:34.760040 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:34.759802    2575 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="1d3c49888a252ebc8c0cb556228b96424251244b198a134089dcf6e295cb5f22" exitCode=0
Oct 31 07:27:34.760481 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:34.759963    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" event={"ID":"508a0686-e4c7-472a-b608-d270a7dbce3d","Type":"ContainerDied","Data":"1d3c49888a252ebc8c0cb556228b96424251244b198a134089dcf6e295cb5f22"}
Oct 31 07:27:34.762934 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:34.762458    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j9f7v" event={"ID":"06e7dac1-d91c-4928-bbca-a4d1535e2170","Type":"ContainerStarted","Data":"a02e2d844eb31e6945b357f6d5133e6fdc4281895c1f097d1554433c04c4d474"}
Oct 31 07:27:34.764523 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:34.764488    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzt8h" event={"ID":"408136c3-732d-4564-a1f8-c969888f361d","Type":"ContainerStarted","Data":"fafa2fd082b1d82980da73805ce912a25eaf0c7c95d72ff7d5e082e69dcd255a"}
Oct 31 07:27:34.767880 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:34.767362    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms" event={"ID":"513eea23-470d-4236-ae17-1666a54ce63f","Type":"ContainerStarted","Data":"d5a3fedf38af34d8b48926154c0b0bbf6976bac2ad9a6486952a90b66841d5b7"}
Oct 31 07:27:34.850618 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:34.850497    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-j9f7v" podStartSLOduration=2.505381587 podStartE2EDuration="10.850479647s" totalImagesPullingTime="8.34509806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:34.849373974 +0000 UTC m=+11.837516517" watchObservedRunningTime="2026-10-31 07:27:34.850479647 +0000 UTC m=+11.838622191"
Oct 31 07:27:34.893662 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:34.893596    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms" podStartSLOduration=2.572160619 podStartE2EDuration="10.893584028s" totalImagesPullingTime="8.321423409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:34.892835344 +0000 UTC m=+11.880977887" watchObservedRunningTime="2026-10-31 07:27:34.893584028 +0000 UTC m=+11.881726620"
Oct 31 07:27:34.935054 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:34.935001    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-hzt8h" podStartSLOduration=2.619102291 podStartE2EDuration="10.934987432s" totalImagesPullingTime="8.315885141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:34.934324916 +0000 UTC m=+11.922467460" watchObservedRunningTime="2026-10-31 07:27:34.934987432 +0000 UTC m=+11.923129975"
Oct 31 07:27:35.504773 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:35.504736    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:35.504949 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:35.504794    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:35.504949 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:35.504753    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:35.504949 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:35.504923    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:35.505122 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:35.505007    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:35.505182 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:35.505127    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:35.772713 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:35.772639    2575 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="2250b3b46ddbebccf6e24ebc36fa25546025f14bc7cfc6b3319e2a5fd325c3ad" exitCode=0
Oct 31 07:27:35.773104 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:35.772741    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" event={"ID":"508a0686-e4c7-472a-b608-d270a7dbce3d","Type":"ContainerDied","Data":"2250b3b46ddbebccf6e24ebc36fa25546025f14bc7cfc6b3319e2a5fd325c3ad"}
Oct 31 07:27:36.776468 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:36.776424    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jm95s" event={"ID":"4820d461-a6e0-49fe-a57c-dbff7bc255f8","Type":"ContainerStarted","Data":"32fe08e3d3957fa9819984cf42754303b42d4aac260772f986ce3472f27178f6"}
Oct 31 07:27:36.777928 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:36.777868    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xmjdj" event={"ID":"29654c5b-afac-4935-b729-3e5b5c8adf50","Type":"ContainerStarted","Data":"0deca1fea366d6dac96cfd648477ebc60f1ccbe6353d759378bd74952b51deb2"}
Oct 31 07:27:36.854569 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:36.854522    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jm95s" podStartSLOduration=4.473023643 podStartE2EDuration="12.854508447s" totalImagesPullingTime="8.381484804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:36.814222979 +0000 UTC m=+13.802365520" watchObservedRunningTime="2026-10-31 07:27:36.854508447 +0000 UTC m=+13.842650990"
Oct 31 07:27:36.855194 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:36.855159    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xmjdj" podStartSLOduration=2.115940804 podStartE2EDuration="12.855149051s" totalImagesPullingTime="10.739208247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:36.854277002 +0000 UTC m=+13.842419544" watchObservedRunningTime="2026-10-31 07:27:36.855149051 +0000 UTC m=+13.843291593"
Oct 31 07:27:37.507711 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:37.507679    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:37.507902 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:37.507791    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:37.507902 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:37.507800    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:37.508041 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:37.507910    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:37.508041 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:37.507952    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:37.508131 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:37.508061    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:37.782790 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:37.782716    2575 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="a03b220fded845581679460899e03ed778ee67051502f84abf0d01b350265621" exitCode=0
Oct 31 07:27:37.783372 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:37.782789    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" event={"ID":"508a0686-e4c7-472a-b608-d270a7dbce3d","Type":"ContainerDied","Data":"a03b220fded845581679460899e03ed778ee67051502f84abf0d01b350265621"}
Oct 31 07:27:39.505711 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:39.504836    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:39.505711 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:39.504855    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:39.505711 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:39.505052    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:39.505711 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:39.505089    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:39.505711 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:39.505186    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:39.505711 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:39.505284    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:39.791580 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:39.791354    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" event={"ID":"508a0686-e4c7-472a-b608-d270a7dbce3d","Type":"ContainerStarted","Data":"4a2b218c73833141e5f6013230bae12f8dfa6a36502353333c19b8e5e8a45e5f"}
Oct 31 07:27:40.795736 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:40.795704    2575 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="4a2b218c73833141e5f6013230bae12f8dfa6a36502353333c19b8e5e8a45e5f" exitCode=0
Oct 31 07:27:40.796127 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:40.795756    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" event={"ID":"508a0686-e4c7-472a-b608-d270a7dbce3d","Type":"ContainerDied","Data":"4a2b218c73833141e5f6013230bae12f8dfa6a36502353333c19b8e5e8a45e5f"}
Oct 31 07:27:41.279575 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.279547    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:41.279670 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.279596    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:41.279708 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.279684    2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:41.279748 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.279736    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret podName:21fea0a5-efb9-4b1a-b561-d173b3ad6169 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.279724152 +0000 UTC m=+34.267866683 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret") pod "global-pull-secret-syncer-qpskk" (UID: "21fea0a5-efb9-4b1a-b561-d173b3ad6169") : object "kube-system"/"original-pull-secret" not registered
Oct 31 07:27:41.279814 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.279684    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:41.279814 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.279787    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs podName:a2320145-3aab-44be-a1c2-7912c2498c30 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.279777338 +0000 UTC m=+34.267919856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs") pod "network-metrics-daemon-fkcpf" (UID: "a2320145-3aab-44be-a1c2-7912c2498c30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 07:27:41.380152 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.380067    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:41.380294 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.380214    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 07:27:41.380294 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.380233    2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 07:27:41.380294 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.380244    2575 projected.go:196] Error preparing data for projected volume kube-api-access-dq2z7 for pod openshift-network-diagnostics/network-check-target-mtrsf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:41.380444 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.380302    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7 podName:647db033-e901-4100-b8a0-a60948730917 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.380283593 +0000 UTC m=+34.368426124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dq2z7" (UniqueName: "kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7") pod "network-check-target-mtrsf" (UID: "647db033-e901-4100-b8a0-a60948730917") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 07:27:41.504834 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.504803    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:41.505009 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.504872    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:41.505009 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.504873    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:41.505009 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.504995    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:41.505128 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.505030    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:41.505128 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:41.505098    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:41.800387 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.800297    2575 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="18598ec35b4d843b4e514ae67b005370e7678f57d42af638cc1d3ab1c34c2390" exitCode=0
Oct 31 07:27:41.800387 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.800363    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" event={"ID":"508a0686-e4c7-472a-b608-d270a7dbce3d","Type":"ContainerDied","Data":"18598ec35b4d843b4e514ae67b005370e7678f57d42af638cc1d3ab1c34c2390"}
Oct 31 07:27:41.803511 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.803490    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" event={"ID":"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265","Type":"ContainerStarted","Data":"1add7ce8a0415aa0611cd691e2b53f0b445020dab2ff614b8b931f0c4c29530e"}
Oct 31 07:27:41.803597 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.803547    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" event={"ID":"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265","Type":"ContainerStarted","Data":"5902df582c17e41f1c169db398fdd5c96b99592a39f2e8b7713e50426c34361f"}
Oct 31 07:27:41.803597 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.803583    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" event={"ID":"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265","Type":"ContainerStarted","Data":"64b25e640f1a343814befa7f78d380186e2f8417e69d90d829b7d731de65d89a"}
Oct 31 07:27:41.803703 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.803612    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" event={"ID":"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265","Type":"ContainerStarted","Data":"82563ca244cff8dc1a24a95693c6e8e5e35921c9f98178b701aa21175c41c47f"}
Oct 31 07:27:41.803703 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.803646    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" event={"ID":"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265","Type":"ContainerStarted","Data":"d215e5a01fd37cec26ec41c5043a19b2295a78db335cdbd32ab46127ae7df38c"}
Oct 31 07:27:41.803703 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:41.803672    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" event={"ID":"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265","Type":"ContainerStarted","Data":"8422609c1fda30f46b21399fa25460a917c59c7c6038db36dfbab59dbd5f4e39"}
Oct 31 07:27:42.808551 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:42.808519    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" event={"ID":"508a0686-e4c7-472a-b608-d270a7dbce3d","Type":"ContainerStarted","Data":"fca8bfebc260c2bcdea7290a0040a287880f08c230606db32f7ccd8e1fd313c2"}
Oct 31 07:27:42.878255 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:42.878205    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6ktj5" podStartSLOduration=8.108165419 podStartE2EDuration="18.878187261s" totalImagesPullingTime="10.770021842s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:42.8641722 +0000 UTC m=+19.852314740" watchObservedRunningTime="2026-10-31 07:27:42.878187261 +0000 UTC m=+19.866329803"
Oct 31 07:27:43.505398 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:43.505369    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:43.505774 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:43.505679    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:43.505851 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:43.505804    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:43.506334 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:43.506174    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:43.509195 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:43.506242    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:43.509195 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:43.507849    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:43.813186 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:43.813150    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" event={"ID":"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265","Type":"ContainerStarted","Data":"ed1297e7b400bd0129ad517f945a4e5a7b3a218c1de02e1b6ac301da675c1e9b"}
Oct 31 07:27:45.504889 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.504852    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:45.505620 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.504904    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:45.505620 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:45.505036    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:45.505620 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:45.505093    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:45.505620 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.505105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:45.505620 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:45.505186    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:45.820931 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.820832    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" event={"ID":"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265","Type":"ContainerStarted","Data":"c9371e3a12199ffc625b4c15e6aaa90aeb60d0cd5b8ac79bad9d810d6e8124f4"}
Oct 31 07:27:45.821180 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.821161    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:45.821293 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.821276    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:45.821366 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.821338    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:45.836082 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.836047    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:45.836216 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.836143    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:27:45.910844 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:45.910798    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l" podStartSLOduration=6.886767384 podStartE2EDuration="21.910785807s" totalImagesPullingTime="15.024018423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:45.91032517 +0000 UTC m=+22.898467749" watchObservedRunningTime="2026-10-31 07:27:45.910785807 +0000 UTC m=+22.898928368"
Oct 31 07:27:47.422391 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:47.422353    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fkcpf"]
Oct 31 07:27:47.422951 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:47.422536    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:47.422951 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:47.422663    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:47.435680 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:47.435652    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mtrsf"]
Oct 31 07:27:47.435816 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:47.435787    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:47.435937 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:47.435891    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:47.436245 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:47.436224    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qpskk"]
Oct 31 07:27:47.436336 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:47.436322    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:47.436422 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:47.436404    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:48.504944 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:48.504902    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:48.505325 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:48.505019    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:49.463299 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:49.463050    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:49.463445 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:49.463427    2575 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:27:49.463726 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:49.463706    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:27:49.505484 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:49.505456    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:49.505847 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:49.505461    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:49.505847 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:49.505592    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:49.505847 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:49.505626    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:50.505016 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:50.504984    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:50.505281 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:50.505098    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:51.504662 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:51.504628    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:51.505165 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:51.504768    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:51.505165 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:51.504812    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:51.505165 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:51.504903    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:52.505436 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:52.505400    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:52.505997 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:52.505522    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtrsf" podUID="647db033-e901-4100-b8a0-a60948730917"
Oct 31 07:27:53.505244 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.505212    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:53.505413 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:53.505307    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpskk" podUID="21fea0a5-efb9-4b1a-b561-d173b3ad6169"
Oct 31 07:27:53.505413 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.505380    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:53.505833 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:53.505474    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fkcpf" podUID="a2320145-3aab-44be-a1c2-7912c2498c30"
Oct 31 07:27:53.842760 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.842679    2575 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeReady"
Oct 31 07:27:53.842908 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.842807    2575 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 31 07:27:53.885955 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.885902    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-zl6kk"]
Oct 31 07:27:53.918619 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.918579    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-79b9f58c8f-wd2zk"]
Oct 31 07:27:53.918791 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.918737    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-zl6kk"
Oct 31 07:27:53.934981 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.934935    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"]
Oct 31 07:27:53.935789 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.935765    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:53.938993 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.938960    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 31 07:27:53.939101 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.939027    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 31 07:27:53.953772 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.953744    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2qw6l"]
Oct 31 07:27:53.953948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.953857    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"
Oct 31 07:27:53.956450 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.956430    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5ktk8\""
Oct 31 07:27:53.956578 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.956492    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 31 07:27:53.956578 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.956542    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 31 07:27:53.956691 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.956593    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 31 07:27:53.968190 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.968168    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46h8f\" (UniqueName: \"kubernetes.io/projected/a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb-kube-api-access-46h8f\") pod \"kas-connection-checker-685895c7c9-zl6kk\" (UID: \"a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb\") " pod="kube-system/kas-connection-checker-685895c7c9-zl6kk"
Oct 31 07:27:53.968308 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.968198    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-default-certificate\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:53.968308 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.968219    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-stats-auth\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:53.968376 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.968343    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvpd\" (UniqueName: \"kubernetes.io/projected/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-kube-api-access-prvpd\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:53.968413 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.968396    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:53.968471 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.968456    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:53.977992 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.977964    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5cb764d49-7pjn2"]
Oct 31 07:27:53.978122 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:53.978094    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-2qw6l"
Oct 31 07:27:54.002056 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.002027    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.002056 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.002038    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-r4hl6"]
Oct 31 07:27:54.016256 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.016233    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"]
Oct 31 07:27:54.016364 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.016339    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-r4hl6"
Oct 31 07:27:54.024955 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.024935    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"]
Oct 31 07:27:54.025072 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.024995    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.029456 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.029436    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pplb8"]
Oct 31 07:27:54.029578 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.029543    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.039732 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.039712    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.039732 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.039728    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.039856 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.039767    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 31 07:27:54.039856 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.039773    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.039856 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.039765    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.045175 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.045158    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"]
Oct 31 07:27:54.045287 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.045273    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:27:54.053327 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.053304    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 31 07:27:54.055510 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.055492    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 31 07:27:54.055605 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.055526    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 31 07:27:54.055605 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.055561    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 31 07:27:54.055733 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.055604    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dvv9v\""
Oct 31 07:27:54.055733 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.055669    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 31 07:27:54.055733 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.055727    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s5wtg\""
Oct 31 07:27:54.055733 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.055729    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rrtkw\""
Oct 31 07:27:54.055888 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.055777    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nzgms\""
Oct 31 07:27:54.055888 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.055799    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 31 07:27:54.056402 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.056387    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"]
Oct 31 07:27:54.056500 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.056488    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.060033 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.060015    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 31 07:27:54.060116 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.060107    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-4qv68\""
Oct 31 07:27:54.065626 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.065610    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"]
Oct 31 07:27:54.065738 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.065725    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.068681 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.068665    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59b48874d4-s59mc"]
Oct 31 07:27:54.068831 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.068813    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.068887 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.068832    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.069015 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.068896    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.069015 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.068950    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46h8f\" (UniqueName: \"kubernetes.io/projected/a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb-kube-api-access-46h8f\") pod \"kas-connection-checker-685895c7c9-zl6kk\" (UID: \"a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb\") " pod="kube-system/kas-connection-checker-685895c7c9-zl6kk"
Oct 31 07:27:54.069015 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.068977    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4kdq\" (UniqueName: \"kubernetes.io/projected/4167bdf8-9b23-482d-805f-c6fdeeda5384-kube-api-access-k4kdq\") pod \"kas-connection-checker-685895c7c9-r4hl6\" (UID: \"4167bdf8-9b23-482d-805f-c6fdeeda5384\") " pod="kube-system/kas-connection-checker-685895c7c9-r4hl6"
Oct 31 07:27:54.069015 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069003    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71156071-2868-4bea-8ba9-20f9e073d996-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.069236 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069030    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-default-certificate\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.069236 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069044    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.069236 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069066    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-stats-auth\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.069236 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069081    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.069236 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069118    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk4xv\" (UniqueName: \"kubernetes.io/projected/6b351b59-c90b-42cb-87b1-228f83da0488-kube-api-access-hk4xv\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.069236 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069135    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t96md\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.069236 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069150    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjfgb\" (UniqueName: \"kubernetes.io/projected/71156071-2868-4bea-8ba9-20f9e073d996-kube-api-access-zjfgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.069236 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069180    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b351b59-c90b-42cb-87b1-228f83da0488-config\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.069236 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069198    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.069677 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069460    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvpd\" (UniqueName: \"kubernetes.io/projected/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-kube-api-access-prvpd\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.069677 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069496    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.069677 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069653    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58wkr\" (UniqueName: \"kubernetes.io/projected/735f0bbc-22c2-4f33-af0d-6fc10cda9e17-kube-api-access-58wkr\") pod \"kas-connection-checker-685895c7c9-2qw6l\" (UID: \"735f0bbc-22c2-4f33-af0d-6fc10cda9e17\") " pod="kube-system/kas-connection-checker-685895c7c9-2qw6l"
Oct 31 07:27:54.069926 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069680    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71156071-2868-4bea-8ba9-20f9e073d996-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.069926 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069760    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhb2p\" (UniqueName: \"kubernetes.io/projected/680bd2c4-08ae-4e24-a6c0-37339d826971-kube-api-access-bhb2p\") pod \"volume-data-source-validator-58c9f5f46d-g72nq\" (UID: \"680bd2c4-08ae-4e24-a6c0-37339d826971\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"
Oct 31 07:27:54.069926 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.070049 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.069950    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 07:27:54.070049 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.069958    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.070049 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.070005    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:54.569986974 +0000 UTC m=+31.558129506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : secret "router-metrics-certs-default" not found
Oct 31 07:27:54.070049 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.070019    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.070049 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.070047    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b351b59-c90b-42cb-87b1-228f83da0488-serving-cert\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.070286 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.070142    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:54.570128055 +0000 UTC m=+31.558270590 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : configmap references non-existent config key: service-ca.crt
Oct 31 07:27:54.071392 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.071367    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 31 07:27:54.071485 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.071443    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7kbgw\""
Oct 31 07:27:54.074204 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.074187    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-default-certificate\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.074278 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.074206    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-stats-auth\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.076610 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.076595    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-7c4986d449-6krlj"]
Oct 31 07:27:54.076738 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.076720    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.080635 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.080614    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kxp8c\""
Oct 31 07:27:54.080749 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.080731    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 31 07:27:54.083437 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.083414    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 31 07:27:54.084297 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.084278    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-24gf5\""
Oct 31 07:27:54.087824 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.087807    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"]
Oct 31 07:27:54.087942 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.087907    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.092840 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.092788    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46h8f\" (UniqueName: \"kubernetes.io/projected/a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb-kube-api-access-46h8f\") pod \"kas-connection-checker-685895c7c9-zl6kk\" (UID: \"a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb\") " pod="kube-system/kas-connection-checker-685895c7c9-zl6kk"
Oct 31 07:27:54.095078 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.095057    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvpd\" (UniqueName: \"kubernetes.io/projected/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-kube-api-access-prvpd\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.106072 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.106050    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rw59c"]
Oct 31 07:27:54.106183 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.106162    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"
Oct 31 07:27:54.126178 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.126152    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b4zz8"]
Oct 31 07:27:54.126286 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.126259    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:27:54.139876 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.139858    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.140005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.139904    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.140005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.139947    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 31 07:27:54.140005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.139952    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 31 07:27:54.140005 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.139947    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 31 07:27:54.140133 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140091    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 31 07:27:54.140167 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140160    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.140292 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140269    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.140403 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140390    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.140403 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140399    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.140550 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140538    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.140600 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140581    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 31 07:27:54.140661 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140645    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.140752 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140727    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.140811 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140745    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 31 07:27:54.140811 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140766    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.140811 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140782    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.140811 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140796    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.140988 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140826    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.140988 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.140839    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.141694 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.141681    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 07:27:54.141826 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.141813    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 31 07:27:54.141874 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.141863    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 07:27:54.146476 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146458    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-zl6kk"]
Oct 31 07:27:54.146565 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146487    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"]
Oct 31 07:27:54.146565 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146503    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2qw6l"]
Oct 31 07:27:54.146565 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146518    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79b9f58c8f-wd2zk"]
Oct 31 07:27:54.146565 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146532    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb764d49-7pjn2"]
Oct 31 07:27:54.146565 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146544    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"]
Oct 31 07:27:54.146565 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146557    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"]
Oct 31 07:27:54.146565 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146569    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"]
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146583    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"]
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146585    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146595    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"]
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146610    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-6krlj"]
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146624    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rw59c"]
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146638    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-r4hl6"]
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146651    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pplb8"]
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146665    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4zz8"]
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146680    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"]
Oct 31 07:27:54.146842 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.146693    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59b48874d4-s59mc"]
Oct 31 07:27:54.154607 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.154588    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 31 07:27:54.154717 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.154699    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 31 07:27:54.155753 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.155731    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 07:27:54.156018 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.156001    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-frnnq\""
Oct 31 07:27:54.156018 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.156014    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mx89s\""
Oct 31 07:27:54.156112 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.156039    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 31 07:27:54.156112 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.156062    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-wkhqf\""
Oct 31 07:27:54.161613 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.161565    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 07:27:54.161613 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.161592    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 07:27:54.161738 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.161684    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vhq6\""
Oct 31 07:27:54.170331 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170314    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-service-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.170401 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170339    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccea0fe7-8780-408e-b799-299e44328b4f-serving-cert\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.170401 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170362    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t96md\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.170401 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170378    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-trusted-ca\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.170401 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170394    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvs8d\" (UniqueName: \"kubernetes.io/projected/078fdc95-76b1-4323-9985-905f939dbbc4-kube-api-access-lvs8d\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.170550 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170536    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.170634 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170617    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.170702 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170654    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.170702 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170684    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.170789 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170748    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a867c49-34bc-4114-8ee9-c3f30900d501-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:27:54.170819 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170800    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.170892 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170875    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58wkr\" (UniqueName: \"kubernetes.io/projected/735f0bbc-22c2-4f33-af0d-6fc10cda9e17-kube-api-access-58wkr\") pod \"kas-connection-checker-685895c7c9-2qw6l\" (UID: \"735f0bbc-22c2-4f33-af0d-6fc10cda9e17\") " pod="kube-system/kas-connection-checker-685895c7c9-2qw6l"
Oct 31 07:27:54.170951 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170906    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71156071-2868-4bea-8ba9-20f9e073d996-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.170991 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170953    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk28k\" (UniqueName: \"kubernetes.io/projected/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-kube-api-access-nk28k\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:27:54.170991 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170978    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.171085 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.170990    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-tmp\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.171085 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171037    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f49g\" (UniqueName: \"kubernetes.io/projected/9a46a25a-59fe-4cd2-8566-4203c84b5175-kube-api-access-8f49g\") pod \"network-check-source-6f78d59f99-clcqg\" (UID: \"9a46a25a-59fe-4cd2-8566-4203c84b5175\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"
Oct 31 07:27:54.171206 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171087    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b351b59-c90b-42cb-87b1-228f83da0488-serving-cert\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.171206 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171104    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.171206 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171115    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.171206 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171142    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.171206 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171170    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/078fdc95-76b1-4323-9985-905f939dbbc4-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171224    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171254    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4kdq\" (UniqueName: \"kubernetes.io/projected/4167bdf8-9b23-482d-805f-c6fdeeda5384-kube-api-access-k4kdq\") pod \"kas-connection-checker-685895c7c9-r4hl6\" (UID: \"4167bdf8-9b23-482d-805f-c6fdeeda5384\") " pod="kube-system/kas-connection-checker-685895c7c9-r4hl6"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171281    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71156071-2868-4bea-8ba9-20f9e073d996-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171309    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171334    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171361    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171386    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjfgb\" (UniqueName: \"kubernetes.io/projected/71156071-2868-4bea-8ba9-20f9e073d996-kube-api-access-zjfgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171410    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171435    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggnwk\" (UniqueName: \"kubernetes.io/projected/904b6555-9c6d-4489-9b17-0d96d5fe2c12-kube-api-access-ggnwk\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171461    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.171486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171487    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2v55\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.172025 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171539    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71156071-2868-4bea-8ba9-20f9e073d996-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.172025 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171731    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-snapshots\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.172025 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171784    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk4xv\" (UniqueName: \"kubernetes.io/projected/6b351b59-c90b-42cb-87b1-228f83da0488-kube-api-access-hk4xv\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.172025 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171818    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/904b6555-9c6d-4489-9b17-0d96d5fe2c12-serving-cert\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.172025 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171899    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79qlm\" (UniqueName: \"kubernetes.io/projected/ccea0fe7-8780-408e-b799-299e44328b4f-kube-api-access-79qlm\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.172025 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.171999    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b351b59-c90b-42cb-87b1-228f83da0488-config\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.172288 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172050    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:27:54.172288 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172090    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.172288 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172160    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-cert\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:27:54.172288 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172192    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.172288 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172225    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhb2p\" (UniqueName: \"kubernetes.io/projected/680bd2c4-08ae-4e24-a6c0-37339d826971-kube-api-access-bhb2p\") pod \"volume-data-source-validator-58c9f5f46d-g72nq\" (UID: \"680bd2c4-08ae-4e24-a6c0-37339d826971\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"
Oct 31 07:27:54.172288 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172257    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk4bt\" (UniqueName: \"kubernetes.io/projected/5a3e7931-f6a9-419d-8cce-5c884e627036-kube-api-access-gk4bt\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.172530 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172307    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.172530 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172311    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.172530 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172436    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.172530 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172474    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.172530 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172506    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-config\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.172530 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.172511    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b351b59-c90b-42cb-87b1-228f83da0488-config\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.172737 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.172635    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:27:54.172737 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.172650    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb764d49-7pjn2: secret "image-registry-tls" not found
Oct 31 07:27:54.172737 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.172708    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls podName:ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:54.67268921 +0000 UTC m=+31.660831730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls") pod "image-registry-5cb764d49-7pjn2" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6") : secret "image-registry-tls" not found
Oct 31 07:27:54.173827 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.173809    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b351b59-c90b-42cb-87b1-228f83da0488-serving-cert\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.173878 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.173847    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71156071-2868-4bea-8ba9-20f9e073d996-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.174456 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.174440    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.174572 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.174556    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.190726 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.190700    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4kdq\" (UniqueName: \"kubernetes.io/projected/4167bdf8-9b23-482d-805f-c6fdeeda5384-kube-api-access-k4kdq\") pod \"kas-connection-checker-685895c7c9-r4hl6\" (UID: \"4167bdf8-9b23-482d-805f-c6fdeeda5384\") " pod="kube-system/kas-connection-checker-685895c7c9-r4hl6"
Oct 31 07:27:54.191010 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.190983    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t96md\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.191104 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.191025    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.191464 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.191436    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjfgb\" (UniqueName: \"kubernetes.io/projected/71156071-2868-4bea-8ba9-20f9e073d996-kube-api-access-zjfgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.191704 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.191685    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk4xv\" (UniqueName: \"kubernetes.io/projected/6b351b59-c90b-42cb-87b1-228f83da0488-kube-api-access-hk4xv\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.192379 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.192361    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58wkr\" (UniqueName: \"kubernetes.io/projected/735f0bbc-22c2-4f33-af0d-6fc10cda9e17-kube-api-access-58wkr\") pod \"kas-connection-checker-685895c7c9-2qw6l\" (UID: \"735f0bbc-22c2-4f33-af0d-6fc10cda9e17\") " pod="kube-system/kas-connection-checker-685895c7c9-2qw6l"
Oct 31 07:27:54.192459 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.192390    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhb2p\" (UniqueName: \"kubernetes.io/projected/680bd2c4-08ae-4e24-a6c0-37339d826971-kube-api-access-bhb2p\") pod \"volume-data-source-validator-58c9f5f46d-g72nq\" (UID: \"680bd2c4-08ae-4e24-a6c0-37339d826971\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"
Oct 31 07:27:54.244010 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.243984    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-zl6kk"
Oct 31 07:27:54.273141 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273120    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-snapshots\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.273239 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273157    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/904b6555-9c6d-4489-9b17-0d96d5fe2c12-serving-cert\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.273239 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273174    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79qlm\" (UniqueName: \"kubernetes.io/projected/ccea0fe7-8780-408e-b799-299e44328b4f-kube-api-access-79qlm\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.273239 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273193    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:27:54.273239 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273213    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.273239 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273231    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-cert\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:27:54.273493 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273255    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.273493 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273274    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z2c6\" (UniqueName: \"kubernetes.io/projected/e248978c-acdb-47f0-b702-c0029711230d-kube-api-access-4z2c6\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.273493 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273292    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk4bt\" (UniqueName: \"kubernetes.io/projected/5a3e7931-f6a9-419d-8cce-5c884e627036-kube-api-access-gk4bt\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.273493 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.273290    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 07:27:54.273493 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273308    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.273493 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.273346    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 07:27:54.273493 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273368    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248978c-acdb-47f0-b702-c0029711230d-tmp-dir\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.273493 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.273398    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls podName:078fdc95-76b1-4323-9985-905f939dbbc4 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:54.773381363 +0000 UTC m=+31.761523911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-84prv" (UID: "078fdc95-76b1-4323-9985-905f939dbbc4") : secret "cluster-monitoring-operator-tls" not found
Oct 31 07:27:54.273493 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.273446    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert podName:2a867c49-34bc-4114-8ee9-c3f30900d501 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:54.773433084 +0000 UTC m=+31.761575609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pplb8" (UID: "2a867c49-34bc-4114-8ee9-c3f30900d501") : secret "networking-console-plugin-cert" not found
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273499    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-config\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.273508    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.273525    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b48874d4-s59mc: secret "image-registry-tls" not found
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273529    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-service-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273553    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccea0fe7-8780-408e-b799-299e44328b4f-serving-cert\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.273565    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls podName:9f39613d-2e12-4ac7-a5d3-e6429b3b874f nodeName:}" failed. No retries permitted until 2026-10-31 07:27:54.773549437 +0000 UTC m=+31.761691979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls") pod "image-registry-59b48874d4-s59mc" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f") : secret "image-registry-tls" not found
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273596    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e248978c-acdb-47f0-b702-c0029711230d-config-volume\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273631    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-trusted-ca\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273660    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvs8d\" (UniqueName: \"kubernetes.io/projected/078fdc95-76b1-4323-9985-905f939dbbc4-kube-api-access-lvs8d\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273777    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273831    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a867c49-34bc-4114-8ee9-c3f30900d501-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273861    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.273948 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273946    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk28k\" (UniqueName: \"kubernetes.io/projected/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-kube-api-access-nk28k\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.273980    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.273995    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-snapshots\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274005    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-tmp\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.274028    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls podName:5a3e7931-f6a9-419d-8cce-5c884e627036 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:54.774013876 +0000 UTC m=+31.762156396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-nl4vc" (UID: "5a3e7931-f6a9-419d-8cce-5c884e627036") : secret "samples-operator-tls" not found
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274202    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-config\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274235    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f49g\" (UniqueName: \"kubernetes.io/projected/9a46a25a-59fe-4cd2-8566-4203c84b5175-kube-api-access-8f49g\") pod \"network-check-source-6f78d59f99-clcqg\" (UID: \"9a46a25a-59fe-4cd2-8566-4203c84b5175\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274290    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274318    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274342    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/078fdc95-76b1-4323-9985-905f939dbbc4-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274374    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274407    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274432    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274463    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274490    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggnwk\" (UniqueName: \"kubernetes.io/projected/904b6555-9c6d-4489-9b17-0d96d5fe2c12-kube-api-access-ggnwk\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274525    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2v55\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.274682 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274575    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-service-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.275416 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274745    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a867c49-34bc-4114-8ee9-c3f30900d501-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:27:54.275416 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.274866    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.275416 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.275115    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.275416 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.275349    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/078fdc95-76b1-4323-9985-905f939dbbc4-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.275689 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.275635    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.275689 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.275669    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.275863 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.275708    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.275863 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.275789    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-trusted-ca\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.276001 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.275886    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-tmp\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.276642 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.276618    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccea0fe7-8780-408e-b799-299e44328b4f-serving-cert\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.276731 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.276700    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-cert\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:27:54.277431 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.277413    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.277568 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.277553    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/904b6555-9c6d-4489-9b17-0d96d5fe2c12-serving-cert\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.277677 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.277662    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.292758 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.292731    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"
Oct 31 07:27:54.299541 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.299509    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk4bt\" (UniqueName: \"kubernetes.io/projected/5a3e7931-f6a9-419d-8cce-5c884e627036-kube-api-access-gk4bt\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.300181 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.300155    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79qlm\" (UniqueName: \"kubernetes.io/projected/ccea0fe7-8780-408e-b799-299e44328b4f-kube-api-access-79qlm\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.300320 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.300295    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.300896 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.300872    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggnwk\" (UniqueName: \"kubernetes.io/projected/904b6555-9c6d-4489-9b17-0d96d5fe2c12-kube-api-access-ggnwk\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.301007 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.300988    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2v55\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.301637 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.301616    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk28k\" (UniqueName: \"kubernetes.io/projected/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-kube-api-access-nk28k\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:27:54.302267 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.302246    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvs8d\" (UniqueName: \"kubernetes.io/projected/078fdc95-76b1-4323-9985-905f939dbbc4-kube-api-access-lvs8d\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.308510 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.308481    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f49g\" (UniqueName: \"kubernetes.io/projected/9a46a25a-59fe-4cd2-8566-4203c84b5175-kube-api-access-8f49g\") pod \"network-check-source-6f78d59f99-clcqg\" (UID: \"9a46a25a-59fe-4cd2-8566-4203c84b5175\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"
Oct 31 07:27:54.312896 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.312876    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-2qw6l"
Oct 31 07:27:54.327774 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.327758    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kas-connection-checker-685895c7c9-r4hl6"
Oct 31 07:27:54.352085 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.351860    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:27:54.367974 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.367879    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:27:54.382744 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.382708    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.383002 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.382983    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z2c6\" (UniqueName: \"kubernetes.io/projected/e248978c-acdb-47f0-b702-c0029711230d-kube-api-access-4z2c6\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.383092 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.383035    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248978c-acdb-47f0-b702-c0029711230d-tmp-dir\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.383149 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.383109    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e248978c-acdb-47f0-b702-c0029711230d-config-volume\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.393310 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.389406    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 07:27:54.393310 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.389514    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls podName:e248978c-acdb-47f0-b702-c0029711230d nodeName:}" failed. No retries permitted until 2026-10-31 07:27:54.889474497 +0000 UTC m=+31.877617107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls") pod "dns-default-b4zz8" (UID: "e248978c-acdb-47f0-b702-c0029711230d") : secret "dns-default-metrics-tls" not found
Oct 31 07:27:54.396418 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.394785    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248978c-acdb-47f0-b702-c0029711230d-tmp-dir\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.396418 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.395776    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e248978c-acdb-47f0-b702-c0029711230d-config-volume\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.396979 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.396742    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:54.433475 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.433401    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z2c6\" (UniqueName: \"kubernetes.io/projected/e248978c-acdb-47f0-b702-c0029711230d-kube-api-access-4z2c6\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.462554 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.462523    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"
Oct 31 07:27:54.475642 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.475130    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:27:54.508253 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.504955    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:54.520547 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.520511    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-548vl\""
Oct 31 07:27:54.567851 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.567761    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:27:54.585897 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.585874    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.586018 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.585907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:54.586062 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.586024    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 07:27:54.586110 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.586096    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:55.586078554 +0000 UTC m=+32.574221072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : configmap references non-existent config key: service-ca.crt
Oct 31 07:27:54.586158 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.586120    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:55.586112336 +0000 UTC m=+32.574254855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : secret "router-metrics-certs-default" not found
Oct 31 07:27:54.602726 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.602662    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-zl6kk"]
Oct 31 07:27:54.606354 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:54.606311    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f02f3f_6e1b_4449_a766_90dfe0ab8cbb.slice/crio-2c29d7fa71c62cdece9daae0eda413e926bdaa81da35325cc86d337d0800a7fd WatchSource:0}: Error finding container 2c29d7fa71c62cdece9daae0eda413e926bdaa81da35325cc86d337d0800a7fd: Status 404 returned error can't find the container with id 2c29d7fa71c62cdece9daae0eda413e926bdaa81da35325cc86d337d0800a7fd
Oct 31 07:27:54.636507 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.636482    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"]
Oct 31 07:27:54.638670 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:54.637982    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod680bd2c4_08ae_4e24_a6c0_37339d826971.slice/crio-f52400aca8e99b03ee91be055f11689304165f4ed69cce0796c8ad8768c73e60 WatchSource:0}: Error finding container f52400aca8e99b03ee91be055f11689304165f4ed69cce0796c8ad8768c73e60: Status 404 returned error can't find the container with id f52400aca8e99b03ee91be055f11689304165f4ed69cce0796c8ad8768c73e60
Oct 31 07:27:54.662678 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.662600    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-2qw6l"]
Oct 31 07:27:54.666507 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.666469    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/kas-connection-checker-685895c7c9-r4hl6"]
Oct 31 07:27:54.666860 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:54.666831    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735f0bbc_22c2_4f33_af0d_6fc10cda9e17.slice/crio-626292732b189f0a88531cf479737061bf352473bfc57ead302dd6f7ea19e083 WatchSource:0}: Error finding container 626292732b189f0a88531cf479737061bf352473bfc57ead302dd6f7ea19e083: Status 404 returned error can't find the container with id 626292732b189f0a88531cf479737061bf352473bfc57ead302dd6f7ea19e083
Oct 31 07:27:54.670766 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:54.670703    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4167bdf8_9b23_482d_805f_c6fdeeda5384.slice/crio-9f3e973fbb857b823585edb8f7e3ebf0ddb14a380d9b0ec9aaca95bd3276082d WatchSource:0}: Error finding container 9f3e973fbb857b823585edb8f7e3ebf0ddb14a380d9b0ec9aaca95bd3276082d: Status 404 returned error can't find the container with id 9f3e973fbb857b823585edb8f7e3ebf0ddb14a380d9b0ec9aaca95bd3276082d
Oct 31 07:27:54.686901 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.686652    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:54.686901 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.686809    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:27:54.686901 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.686823    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb764d49-7pjn2: secret "image-registry-tls" not found
Oct 31 07:27:54.686901 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.686879    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls podName:ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:55.686859614 +0000 UTC m=+32.675002148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls") pod "image-registry-5cb764d49-7pjn2" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6") : secret "image-registry-tls" not found
Oct 31 07:27:54.705999 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.705970    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"]
Oct 31 07:27:54.729257 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.729219    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"]
Oct 31 07:27:54.732239 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.732215    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"]
Oct 31 07:27:54.735677 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:54.735639    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccea0fe7_8780_408e_b799_299e44328b4f.slice/crio-6c81d44f5390e022b44db75eca8b84f82eebec773b2479f861ff781cda6818e4 WatchSource:0}: Error finding container 6c81d44f5390e022b44db75eca8b84f82eebec773b2479f861ff781cda6818e4: Status 404 returned error can't find the container with id 6c81d44f5390e022b44db75eca8b84f82eebec773b2479f861ff781cda6818e4
Oct 31 07:27:54.736451 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:54.736420    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b351b59_c90b_42cb_87b1_228f83da0488.slice/crio-78cee45ff085d114a5ed0c7d97cb295a14ddc15f810dd71334dcf9eee3fa5687 WatchSource:0}: Error finding container 78cee45ff085d114a5ed0c7d97cb295a14ddc15f810dd71334dcf9eee3fa5687: Status 404 returned error can't find the container with id 78cee45ff085d114a5ed0c7d97cb295a14ddc15f810dd71334dcf9eee3fa5687
Oct 31 07:27:54.787355 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.787166    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:54.787447 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.787294    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:27:54.787447 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.787422    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:54.787536 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.787524    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:27:54.787570 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.787430    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b48874d4-s59mc: secret "image-registry-tls" not found
Oct 31 07:27:54.787570 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.787558    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:54.787629 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.787581    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls podName:9f39613d-2e12-4ac7-a5d3-e6429b3b874f nodeName:}" failed. No retries permitted until 2026-10-31 07:27:55.787566842 +0000 UTC m=+32.775709361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls") pod "image-registry-59b48874d4-s59mc" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f") : secret "image-registry-tls" not found
Oct 31 07:27:54.787668 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.787474    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 07:27:54.787668 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.787658    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 07:27:54.787725 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.787673    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 07:27:54.787725 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.787689    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls podName:5a3e7931-f6a9-419d-8cce-5c884e627036 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:55.787672786 +0000 UTC m=+32.775815332 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-nl4vc" (UID: "5a3e7931-f6a9-419d-8cce-5c884e627036") : secret "samples-operator-tls" not found
Oct 31 07:27:54.787725 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.787706    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls podName:078fdc95-76b1-4323-9985-905f939dbbc4 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:55.787697335 +0000 UTC m=+32.775839857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-84prv" (UID: "078fdc95-76b1-4323-9985-905f939dbbc4") : secret "cluster-monitoring-operator-tls" not found
Oct 31 07:27:54.787725 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.787721    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert podName:2a867c49-34bc-4114-8ee9-c3f30900d501 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:55.787712916 +0000 UTC m=+32.775855434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pplb8" (UID: "2a867c49-34bc-4114-8ee9-c3f30900d501") : secret "networking-console-plugin-cert" not found
Oct 31 07:27:54.791716 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.791692    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rw59c"]
Oct 31 07:27:54.795068 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:54.795032    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6e9a9a_37e4_4f68_975d_fada2cfc80ec.slice/crio-c8c0dc0861d65b0145f2bd4ff977609829a728df3f1c28f7468aec8d6abb228e WatchSource:0}: Error finding container c8c0dc0861d65b0145f2bd4ff977609829a728df3f1c28f7468aec8d6abb228e: Status 404 returned error can't find the container with id c8c0dc0861d65b0145f2bd4ff977609829a728df3f1c28f7468aec8d6abb228e
Oct 31 07:27:54.795450 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.795404    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"]
Oct 31 07:27:54.798731 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:54.798707    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a46a25a_59fe_4cd2_8566_4203c84b5175.slice/crio-e3bb7d9d6ee1f636bc108e8694142b265f73a06a535518460a0f3368271bf954 WatchSource:0}: Error finding container e3bb7d9d6ee1f636bc108e8694142b265f73a06a535518460a0f3368271bf954: Status 404 returned error can't find the container with id e3bb7d9d6ee1f636bc108e8694142b265f73a06a535518460a0f3368271bf954
Oct 31 07:27:54.842151 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.842115    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rw59c" event={"ID":"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec","Type":"ContainerStarted","Data":"c8c0dc0861d65b0145f2bd4ff977609829a728df3f1c28f7468aec8d6abb228e"}
Oct 31 07:27:54.843162 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.843134    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9" event={"ID":"6b351b59-c90b-42cb-87b1-228f83da0488","Type":"ContainerStarted","Data":"78cee45ff085d114a5ed0c7d97cb295a14ddc15f810dd71334dcf9eee3fa5687"}
Oct 31 07:27:54.844466 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.844439    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-2qw6l" event={"ID":"735f0bbc-22c2-4f33-af0d-6fc10cda9e17","Type":"ContainerStarted","Data":"2c39bf26ad204b24828a4b9fd6bdf8f525aad09d3f3078c404a0cae03d8f4a98"}
Oct 31 07:27:54.844605 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.844479    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-2qw6l" event={"ID":"735f0bbc-22c2-4f33-af0d-6fc10cda9e17","Type":"ContainerStarted","Data":"626292732b189f0a88531cf479737061bf352473bfc57ead302dd6f7ea19e083"}
Oct 31 07:27:54.845586 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.845565    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" event={"ID":"ccea0fe7-8780-408e-b799-299e44328b4f","Type":"ContainerStarted","Data":"6c81d44f5390e022b44db75eca8b84f82eebec773b2479f861ff781cda6818e4"}
Oct 31 07:27:54.846972 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.846941    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-zl6kk" event={"ID":"a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb","Type":"ContainerStarted","Data":"e439dec18c65b78b4d1a606224f737c2cf5a057f585b5fc47f733b033a397d55"}
Oct 31 07:27:54.847063 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.846996    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-zl6kk" event={"ID":"a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb","Type":"ContainerStarted","Data":"2c29d7fa71c62cdece9daae0eda413e926bdaa81da35325cc86d337d0800a7fd"}
Oct 31 07:27:54.848064 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.848043    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg" event={"ID":"9a46a25a-59fe-4cd2-8566-4203c84b5175","Type":"ContainerStarted","Data":"e3bb7d9d6ee1f636bc108e8694142b265f73a06a535518460a0f3368271bf954"}
Oct 31 07:27:54.851190 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.851165    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-r4hl6" event={"ID":"4167bdf8-9b23-482d-805f-c6fdeeda5384","Type":"ContainerStarted","Data":"368a64b5873efcd57d0de01f5748696594aece0b94e429e36ef622f40bfc0fd0"}
Oct 31 07:27:54.851275 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.851203    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kas-connection-checker-685895c7c9-r4hl6" event={"ID":"4167bdf8-9b23-482d-805f-c6fdeeda5384","Type":"ContainerStarted","Data":"9f3e973fbb857b823585edb8f7e3ebf0ddb14a380d9b0ec9aaca95bd3276082d"}
Oct 31 07:27:54.853307 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.853228    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq" event={"ID":"680bd2c4-08ae-4e24-a6c0-37339d826971","Type":"ContainerStarted","Data":"f52400aca8e99b03ee91be055f11689304165f4ed69cce0796c8ad8768c73e60"}
Oct 31 07:27:54.854460 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.854436    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg" event={"ID":"71156071-2868-4bea-8ba9-20f9e073d996","Type":"ContainerStarted","Data":"ddb7f8f4c8b171aaff7ea88759f6199e086e6567ff926dbd4d4eb906f8451386"}
Oct 31 07:27:54.872551 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.872523    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-7c4986d449-6krlj"]
Oct 31 07:27:54.875271 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:54.875248    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904b6555_9c6d_4489_9b17_0d96d5fe2c12.slice/crio-0192053c48aef8c4e7de04c639b6fda6ce44e1f931fd7bc4b5414f2125bd02b1 WatchSource:0}: Error finding container 0192053c48aef8c4e7de04c639b6fda6ce44e1f931fd7bc4b5414f2125bd02b1: Status 404 returned error can't find the container with id 0192053c48aef8c4e7de04c639b6fda6ce44e1f931fd7bc4b5414f2125bd02b1
Oct 31 07:27:54.881845 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.881790    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-2qw6l" podStartSLOduration=433.881774498 podStartE2EDuration="7m13.881774498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:54.881675041 +0000 UTC m=+31.869817576" watchObservedRunningTime="2026-10-31 07:27:54.881774498 +0000 UTC m=+31.869917040"
Oct 31 07:27:54.919067 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.919023    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-r4hl6" podStartSLOduration=433.919011018 podStartE2EDuration="7m13.919011018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:54.918596056 +0000 UTC m=+31.906738597" watchObservedRunningTime="2026-10-31 07:27:54.919011018 +0000 UTC m=+31.907153557"
Oct 31 07:27:54.956455 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.956395    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kas-connection-checker-685895c7c9-zl6kk" podStartSLOduration=433.956380035 podStartE2EDuration="7m13.956380035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:54.955676084 +0000 UTC m=+31.943818623" watchObservedRunningTime="2026-10-31 07:27:54.956380035 +0000 UTC m=+31.944522574"
Oct 31 07:27:54.989174 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:54.989140    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:54.989364 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.989302    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 07:27:54.989416 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:54.989382    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls podName:e248978c-acdb-47f0-b702-c0029711230d nodeName:}" failed. No retries permitted until 2026-10-31 07:27:55.989359386 +0000 UTC m=+32.977501920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls") pod "dns-default-b4zz8" (UID: "e248978c-acdb-47f0-b702-c0029711230d") : secret "dns-default-metrics-tls" not found
Oct 31 07:27:55.506083 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.506051    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:55.507309 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.507105    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:55.522263 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.521978    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 07:27:55.522263 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.522092    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nzlr\""
Oct 31 07:27:55.522263 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.522169    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-qk9pc\""
Oct 31 07:27:55.524745 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.524642    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 07:27:55.601037 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.600105    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:55.601037 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.600165    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:55.601037 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.600510    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.60049298 +0000 UTC m=+34.588635514 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : configmap references non-existent config key: service-ca.crt
Oct 31 07:27:55.601037 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.600946    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 07:27:55.601037 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.601000    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.600984207 +0000 UTC m=+34.589126731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : secret "router-metrics-certs-default" not found
Oct 31 07:27:55.702769 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.701577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:55.702769 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.701744    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:27:55.702769 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.701763    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb764d49-7pjn2: secret "image-registry-tls" not found
Oct 31 07:27:55.702769 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.701820    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls podName:ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.701800839 +0000 UTC m=+34.689943380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls") pod "image-registry-5cb764d49-7pjn2" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6") : secret "image-registry-tls" not found
Oct 31 07:27:55.802651 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.802572    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:55.802816 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.802716    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:27:55.802816 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.802756    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:55.802816 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.802783    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:55.802980 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.802962    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:27:55.802980 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.802978    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b48874d4-s59mc: secret "image-registry-tls" not found
Oct 31 07:27:55.803060 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.803039    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls podName:9f39613d-2e12-4ac7-a5d3-e6429b3b874f nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.803020058 +0000 UTC m=+34.791162578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls") pod "image-registry-59b48874d4-s59mc" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f") : secret "image-registry-tls" not found
Oct 31 07:27:55.803475 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.803453    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 07:27:55.803598 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.803513    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls podName:5a3e7931-f6a9-419d-8cce-5c884e627036 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.803497444 +0000 UTC m=+34.791639963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-nl4vc" (UID: "5a3e7931-f6a9-419d-8cce-5c884e627036") : secret "samples-operator-tls" not found
Oct 31 07:27:55.803598 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.803572    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 07:27:55.803718 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.803605    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert podName:2a867c49-34bc-4114-8ee9-c3f30900d501 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.803594247 +0000 UTC m=+34.791736765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pplb8" (UID: "2a867c49-34bc-4114-8ee9-c3f30900d501") : secret "networking-console-plugin-cert" not found
Oct 31 07:27:55.803718 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.803655    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 07:27:55.803718 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:55.803688    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls podName:078fdc95-76b1-4323-9985-905f939dbbc4 nodeName:}" failed. No retries permitted until 2026-10-31 07:27:57.803677585 +0000 UTC m=+34.791820103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-84prv" (UID: "078fdc95-76b1-4323-9985-905f939dbbc4") : secret "cluster-monitoring-operator-tls" not found
Oct 31 07:27:55.863612 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:55.862775    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6krlj" event={"ID":"904b6555-9c6d-4489-9b17-0d96d5fe2c12","Type":"ContainerStarted","Data":"0192053c48aef8c4e7de04c639b6fda6ce44e1f931fd7bc4b5414f2125bd02b1"}
Oct 31 07:27:56.006514 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:56.005197    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:56.006514 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:56.006143    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 07:27:56.006514 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:56.006195    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls podName:e248978c-acdb-47f0-b702-c0029711230d nodeName:}" failed. No retries permitted until 2026-10-31 07:27:58.006180333 +0000 UTC m=+34.994322864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls") pod "dns-default-b4zz8" (UID: "e248978c-acdb-47f0-b702-c0029711230d") : secret "dns-default-metrics-tls" not found
Oct 31 07:27:56.183041 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:56.182874    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:27:56.340479 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:56.340382    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:27:57.319253 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.319167    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:27:57.319839 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.319344    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:57.320641 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.320304    2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Oct 31 07:27:57.320641 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.320385    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs podName:a2320145-3aab-44be-a1c2-7912c2498c30 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:29.32036459 +0000 UTC m=+66.308507112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs") pod "network-metrics-daemon-fkcpf" (UID: "a2320145-3aab-44be-a1c2-7912c2498c30") : secret "metrics-daemon-secret" not found
Oct 31 07:27:57.325147 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.325118    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:57.387416 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.387176    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:27:57.420865 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.420310    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:57.427717 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.427601    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:57.522365 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.520827    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:27:57.624384 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.624346    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:57.624531 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.624405    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:27:57.624700 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.624679    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 07:27:57.624776 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.624750    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:01.624729151 +0000 UTC m=+38.612871671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : secret "router-metrics-certs-default" not found
Oct 31 07:27:57.625111 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.625090    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:01.625067425 +0000 UTC m=+38.613209964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : configmap references non-existent config key: service-ca.crt
Oct 31 07:27:57.725841 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.725808    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:27:57.725841 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.725840    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb764d49-7pjn2: secret "image-registry-tls" not found
Oct 31 07:27:57.726085 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.725898    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls podName:ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:01.725881862 +0000 UTC m=+38.714024396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls") pod "image-registry-5cb764d49-7pjn2" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6") : secret "image-registry-tls" not found
Oct 31 07:27:57.726282 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.726256    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:27:57.745831 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.745685    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qpskk"]
Oct 31 07:27:57.751757 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:27:57.751712    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fea0a5_efb9_4b1a_b561_d173b3ad6169.slice/crio-7c35edefa2c76448c64ca8bc46ca6c176e28c0fd43830dce6d7d567666e59657 WatchSource:0}: Error finding container 7c35edefa2c76448c64ca8bc46ca6c176e28c0fd43830dce6d7d567666e59657: Status 404 returned error can't find the container with id 7c35edefa2c76448c64ca8bc46ca6c176e28c0fd43830dce6d7d567666e59657
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.827270    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.827328    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.827363    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.827430    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.827579    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.827645    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls podName:5a3e7931-f6a9-419d-8cce-5c884e627036 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:01.827625883 +0000 UTC m=+38.815768417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-nl4vc" (UID: "5a3e7931-f6a9-419d-8cce-5c884e627036") : secret "samples-operator-tls" not found
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.828092    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.828145    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert podName:2a867c49-34bc-4114-8ee9-c3f30900d501 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:01.828130428 +0000 UTC m=+38.816272947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pplb8" (UID: "2a867c49-34bc-4114-8ee9-c3f30900d501") : secret "networking-console-plugin-cert" not found
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.828204    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.828239    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls podName:078fdc95-76b1-4323-9985-905f939dbbc4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:01.828228056 +0000 UTC m=+38.816370576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-84prv" (UID: "078fdc95-76b1-4323-9985-905f939dbbc4") : secret "cluster-monitoring-operator-tls" not found
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.828296    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.828306    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b48874d4-s59mc: secret "image-registry-tls" not found
Oct 31 07:27:57.828446 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:57.828336    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls podName:9f39613d-2e12-4ac7-a5d3-e6429b3b874f nodeName:}" failed. No retries permitted until 2026-10-31 07:28:01.828325751 +0000 UTC m=+38.816468270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls") pod "image-registry-59b48874d4-s59mc" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f") : secret "image-registry-tls" not found
Oct 31 07:27:57.875367 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.875278    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mtrsf"]
Oct 31 07:27:57.883346 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.882211    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq" event={"ID":"680bd2c4-08ae-4e24-a6c0-37339d826971","Type":"ContainerStarted","Data":"ef47bd552aaa79c1a545fba8914f6f4f608bfe58fb13e6e3ba22786c86a6cb80"}
Oct 31 07:27:57.885581 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.885487    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qpskk" event={"ID":"21fea0a5-efb9-4b1a-b561-d173b3ad6169","Type":"ContainerStarted","Data":"7c35edefa2c76448c64ca8bc46ca6c176e28c0fd43830dce6d7d567666e59657"}
Oct 31 07:27:57.921187 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:57.921124    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq" podStartSLOduration=389.584597279 podStartE2EDuration="6m31.921107659s" totalImagesPullingTime="2.33651038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:57.920743776 +0000 UTC m=+34.908886310" watchObservedRunningTime="2026-10-31 07:27:57.921107659 +0000 UTC m=+34.909250199"
Oct 31 07:27:58.029450 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:58.029409    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:27:58.029623 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:58.029598    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:27:58.029733 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:58.029717    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 07:27:58.029819 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:27:58.029774    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls podName:e248978c-acdb-47f0-b702-c0029711230d nodeName:}" failed. No retries permitted until 2026-10-31 07:28:02.029760747 +0000 UTC m=+39.017903266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls") pod "dns-default-b4zz8" (UID: "e248978c-acdb-47f0-b702-c0029711230d") : secret "dns-default-metrics-tls" not found
Oct 31 07:27:58.141895 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:58.141803    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:27:58.892214 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:58.892178    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mtrsf" event={"ID":"647db033-e901-4100-b8a0-a60948730917","Type":"ContainerStarted","Data":"90d1896322dcee73dc3b1735a7e273d95193ec4cad4c28746be58079f00a4be8"}
Oct 31 07:27:59.905614 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:59.905575    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" event={"ID":"ccea0fe7-8780-408e-b799-299e44328b4f","Type":"ContainerStarted","Data":"a4dbf7c967f5a459468d1e4168bbcbe31dc3029f0b1019934fce47bf9a520d40"}
Oct 31 07:27:59.907047 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:59.907013    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:27:59.908751 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:59.908397    2575 patch_prober.go:29] interesting pod/console-operator-7cd56b8dbc-bqnjc container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body=
Oct 31 07:27:59.908751 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:59.908439    2575 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" podUID="ccea0fe7-8780-408e-b799-299e44328b4f" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused"
Oct 31 07:27:59.912529 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:59.912496    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg" event={"ID":"71156071-2868-4bea-8ba9-20f9e073d996","Type":"ContainerStarted","Data":"3c39ef7ae1813d5a2497ec8c45b278a00dea42aebd20ab2c25de96e29cebd051"}
Oct 31 07:27:59.916401 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:59.916238    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9" event={"ID":"6b351b59-c90b-42cb-87b1-228f83da0488","Type":"ContainerStarted","Data":"ec411200fc2da5f92aad77ad61a5965f5ee86f52e23477f0299b2b5d349b06b2"}
Oct 31 07:27:59.953321 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:59.953264    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" podStartSLOduration=393.966007881 podStartE2EDuration="6m38.953246489s" totalImagesPullingTime="4.987238608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:59.951764371 +0000 UTC m=+36.939906893" watchObservedRunningTime="2026-10-31 07:27:59.953246489 +0000 UTC m=+36.941389031"
Oct 31 07:27:59.997148 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:59.996528    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9" podStartSLOduration=396.999446885 podStartE2EDuration="6m41.996514141s" totalImagesPullingTime="4.997067256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:27:59.995535442 +0000 UTC m=+36.983677984" watchObservedRunningTime="2026-10-31 07:27:59.996514141 +0000 UTC m=+36.984656681"
Oct 31 07:27:59.998423 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:27:59.998390    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:00.034711 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.034426    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"]
Oct 31 07:28:00.041942 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.040093    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg" podStartSLOduration=397.682465437 podStartE2EDuration="6m42.040074125s" totalImagesPullingTime="4.357608688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:00.038932726 +0000 UTC m=+37.027075269" watchObservedRunningTime="2026-10-31 07:28:00.040074125 +0000 UTC m=+37.028216670"
Oct 31 07:28:00.062739 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.062649    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"]
Oct 31 07:28:00.063015 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.062993    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"
Oct 31 07:28:00.078731 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.078697    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cnphn\""
Oct 31 07:28:00.079972 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.079956    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 31 07:28:00.080148 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.079988    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:00.089654 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.089166    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"]
Oct 31 07:28:00.089654 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.089209    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"]
Oct 31 07:28:00.089654 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.089305    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"
Oct 31 07:28:00.118509 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.118433    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:00.155987 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.155543    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stqt2\" (UniqueName: \"kubernetes.io/projected/aec5e525-a7f4-460d-aceb-f8412e0c3b2b-kube-api-access-stqt2\") pod \"migrator-66df5d496b-vx9p9\" (UID: \"aec5e525-a7f4-460d-aceb-f8412e0c3b2b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"
Oct 31 07:28:00.234145 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.234097    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:00.257140 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.256495    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px9bt\" (UniqueName: \"kubernetes.io/projected/6330753d-1f92-46d9-a1ff-70262d02c414-kube-api-access-px9bt\") pod \"migrator-66df5d496b-hdrmp\" (UID: \"6330753d-1f92-46d9-a1ff-70262d02c414\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"
Oct 31 07:28:00.257140 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.256676    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stqt2\" (UniqueName: \"kubernetes.io/projected/aec5e525-a7f4-460d-aceb-f8412e0c3b2b-kube-api-access-stqt2\") pod \"migrator-66df5d496b-vx9p9\" (UID: \"aec5e525-a7f4-460d-aceb-f8412e0c3b2b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"
Oct 31 07:28:00.276505 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.276480    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stqt2\" (UniqueName: \"kubernetes.io/projected/aec5e525-a7f4-460d-aceb-f8412e0c3b2b-kube-api-access-stqt2\") pod \"migrator-66df5d496b-vx9p9\" (UID: \"aec5e525-a7f4-460d-aceb-f8412e0c3b2b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"
Oct 31 07:28:00.341345 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.341268    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:00.357982 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.357593    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px9bt\" (UniqueName: \"kubernetes.io/projected/6330753d-1f92-46d9-a1ff-70262d02c414-kube-api-access-px9bt\") pod \"migrator-66df5d496b-hdrmp\" (UID: \"6330753d-1f92-46d9-a1ff-70262d02c414\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"
Oct 31 07:28:00.382862 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.382794    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px9bt\" (UniqueName: \"kubernetes.io/projected/6330753d-1f92-46d9-a1ff-70262d02c414-kube-api-access-px9bt\") pod \"migrator-66df5d496b-hdrmp\" (UID: \"6330753d-1f92-46d9-a1ff-70262d02c414\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"
Oct 31 07:28:00.398673 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.398637    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"
Oct 31 07:28:00.426483 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.426262    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"
Oct 31 07:28:00.744966 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.743426    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"]
Oct 31 07:28:00.765386 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:28:00.765340    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaec5e525_a7f4_460d_aceb_f8412e0c3b2b.slice/crio-8a16c8bad71aa477555a9bec2f2efd79bf271f4e7d0d06d7ce161bb37aecdb31 WatchSource:0}: Error finding container 8a16c8bad71aa477555a9bec2f2efd79bf271f4e7d0d06d7ce161bb37aecdb31: Status 404 returned error can't find the container with id 8a16c8bad71aa477555a9bec2f2efd79bf271f4e7d0d06d7ce161bb37aecdb31
Oct 31 07:28:00.781253 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.781220    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:00.800534 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.800503    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"]
Oct 31 07:28:00.805131 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:28:00.805067    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6330753d_1f92_46d9_a1ff_70262d02c414.slice/crio-ec622f400d3a5ffc6f5a88d6919723990928b601e9028d3ea20ea036dfece44e WatchSource:0}: Error finding container ec622f400d3a5ffc6f5a88d6919723990928b601e9028d3ea20ea036dfece44e: Status 404 returned error can't find the container with id ec622f400d3a5ffc6f5a88d6919723990928b601e9028d3ea20ea036dfece44e
Oct 31 07:28:00.896743 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.896704    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:00.922827 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.922794    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/0.log"
Oct 31 07:28:00.923327 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.922840    2575 generic.go:356] "Generic (PLEG): container finished" podID="ccea0fe7-8780-408e-b799-299e44328b4f" containerID="a4dbf7c967f5a459468d1e4168bbcbe31dc3029f0b1019934fce47bf9a520d40" exitCode=255
Oct 31 07:28:00.923327 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.922944    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" event={"ID":"ccea0fe7-8780-408e-b799-299e44328b4f","Type":"ContainerDied","Data":"a4dbf7c967f5a459468d1e4168bbcbe31dc3029f0b1019934fce47bf9a520d40"}
Oct 31 07:28:00.923503 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.923381    2575 scope.go:122] "RemoveContainer" containerID="a4dbf7c967f5a459468d1e4168bbcbe31dc3029f0b1019934fce47bf9a520d40"
Oct 31 07:28:00.927511 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.927418    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6krlj" event={"ID":"904b6555-9c6d-4489-9b17-0d96d5fe2c12","Type":"ContainerStarted","Data":"cf68cd0df0ce091fd335816a40d5a01b1db3b82ea0fb671ed1b621e6e18e1a38"}
Oct 31 07:28:00.929282 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.929167    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp" event={"ID":"6330753d-1f92-46d9-a1ff-70262d02c414","Type":"ContainerStarted","Data":"ec622f400d3a5ffc6f5a88d6919723990928b601e9028d3ea20ea036dfece44e"}
Oct 31 07:28:00.931208 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:00.931184    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9" event={"ID":"aec5e525-a7f4-460d-aceb-f8412e0c3b2b","Type":"ContainerStarted","Data":"8a16c8bad71aa477555a9bec2f2efd79bf271f4e7d0d06d7ce161bb37aecdb31"}
Oct 31 07:28:01.002551 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.002487    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-operator-7c4986d449-6krlj" podStartSLOduration=391.705914753 podStartE2EDuration="6m37.002468124s" totalImagesPullingTime="5.296553371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:01.001369691 +0000 UTC m=+37.989512242" watchObservedRunningTime="2026-10-31 07:28:01.002468124 +0000 UTC m=+37.990610667"
Oct 31 07:28:01.212656 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.212296    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-98qs2"]
Oct 31 07:28:01.235878 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.226574    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.235878 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.232246    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-98qs2"]
Oct 31 07:28:01.242353 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.242323    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 07:28:01.242568 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.242548    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dql9j\""
Oct 31 07:28:01.242666 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.242632    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 07:28:01.289299 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.288608    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-t6jrq-6cxmm"]
Oct 31 07:28:01.303694 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.303664    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.306161 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.306131    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:01.312985 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.312835    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-t6jrq-6cxmm"]
Oct 31 07:28:01.375982 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.375691    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-data-volume\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.375982 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.375773    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.375982 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.375879    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-crio-socket\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.376193 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.376036    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.376193 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.376113    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd52j\" (UniqueName: \"kubernetes.io/projected/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-api-access-rd52j\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.422590 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.422531    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:01.431314 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.431274    2575 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-6ggm8"]
Oct 31 07:28:01.445115 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.445064    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.454206 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.454132    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-6ggm8"]
Oct 31 07:28:01.462968 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.461211    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 31 07:28:01.462968 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.461341    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 31 07:28:01.462968 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.461425    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 31 07:28:01.462968 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.461501    2575 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bbr4n\""
Oct 31 07:28:01.462968 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.461596    2575 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 31 07:28:01.476934 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.476886    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.477095 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.476990    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd52j\" (UniqueName: \"kubernetes.io/projected/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-api-access-rd52j\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.477095 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.477045    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-data-volume\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.477095 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.477078    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.477316 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.477124    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.477316 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.477223    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-crio-socket\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.477316 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.477249    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9kb7\" (UniqueName: \"kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.477316 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.477278    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.477513 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.477349    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.477563 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.477531    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:01.477615 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.477598    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:01.977576656 +0000 UTC m=+38.965719195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:01.478071 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.478014    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-crio-socket\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.478198 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.478086    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 07:28:01.478198 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.478167    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:01.978151289 +0000 UTC m=+38.966293824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : configmap "kube-rbac-proxy" not found
Oct 31 07:28:01.478325 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.478248    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-data-volume\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.510050 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.509989    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd52j\" (UniqueName: \"kubernetes.io/projected/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-api-access-rd52j\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.578273    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.578333    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwvrx\" (UniqueName: \"kubernetes.io/projected/d8753ed2-8968-47dc-aae5-6abc034f7435-kube-api-access-dwvrx\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.578384    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-key\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.578445    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9kb7\" (UniqueName: \"kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.578468    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.578565    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.578604    2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-cabundle\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.579339    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.579545    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.579627 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.579587    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.604125 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.604042    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:01.622002 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.621973    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9kb7\" (UniqueName: \"kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.676161 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.674705    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:01.679752 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.679645    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-cabundle\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.679752 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.679713    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvrx\" (UniqueName: \"kubernetes.io/projected/d8753ed2-8968-47dc-aae5-6abc034f7435-kube-api-access-dwvrx\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.679878 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.679764    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:01.679878 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.679791    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-key\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.679878 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.679824    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:01.680058 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.680033    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:09.680015139 +0000 UTC m=+46.668157672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : configmap references non-existent config key: service-ca.crt
Oct 31 07:28:01.680414 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.680393    2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Oct 31 07:28:01.680509 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.680453    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs podName:4118a0cf-82b9-4bf6-a953-3af32ca0b5f4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:09.680436947 +0000 UTC m=+46.668579479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs") pod "router-default-79b9f58c8f-wd2zk" (UID: "4118a0cf-82b9-4bf6-a953-3af32ca0b5f4") : secret "router-metrics-certs-default" not found
Oct 31 07:28:01.680509 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.680455    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-cabundle\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.683880 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.683836    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-key\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.705587 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.705560    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwvrx\" (UniqueName: \"kubernetes.io/projected/d8753ed2-8968-47dc-aae5-6abc034f7435-kube-api-access-dwvrx\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.781328 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.780735    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:01.781328 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.780946    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:28:01.781328 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.780965    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb764d49-7pjn2: secret "image-registry-tls" not found
Oct 31 07:28:01.781328 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.781020    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls podName:ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:09.781002836 +0000 UTC m=+46.769145371 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls") pod "image-registry-5cb764d49-7pjn2" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6") : secret "image-registry-tls" not found
Oct 31 07:28:01.781328 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.781106    2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:01.882023 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.881603    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:01.882023 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.881755    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:01.882023 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.881811    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:01.882023 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.881821    2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Oct 31 07:28:01.882023 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.881836    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:01.882023 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.881890    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls podName:5a3e7931-f6a9-419d-8cce-5c884e627036 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:09.881870227 +0000 UTC m=+46.870012769 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls") pod "cluster-samples-operator-6ddb6c8b94-nl4vc" (UID: "5a3e7931-f6a9-419d-8cce-5c884e627036") : secret "samples-operator-tls" not found
Oct 31 07:28:01.882023 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.881989    2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:28:01.882023 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.882000    2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b48874d4-s59mc: secret "image-registry-tls" not found
Oct 31 07:28:01.882023 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.882038    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls podName:9f39613d-2e12-4ac7-a5d3-e6429b3b874f nodeName:}" failed. No retries permitted until 2026-10-31 07:28:09.882027309 +0000 UTC m=+46.870169828 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls") pod "image-registry-59b48874d4-s59mc" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f") : secret "image-registry-tls" not found
Oct 31 07:28:01.882567 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.882082    2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 07:28:01.882567 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.882103    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert podName:2a867c49-34bc-4114-8ee9-c3f30900d501 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:09.882096784 +0000 UTC m=+46.870239301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pplb8" (UID: "2a867c49-34bc-4114-8ee9-c3f30900d501") : secret "networking-console-plugin-cert" not found
Oct 31 07:28:01.882567 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.882146    2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:01.882567 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.882166    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls podName:078fdc95-76b1-4323-9985-905f939dbbc4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:09.88216063 +0000 UTC m=+46.870303148 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-84prv" (UID: "078fdc95-76b1-4323-9985-905f939dbbc4") : secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:01.942233 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.942156    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:28:01.943181 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.943154    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/0.log"
Oct 31 07:28:01.943297 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.943192    2575 generic.go:356] "Generic (PLEG): container finished" podID="ccea0fe7-8780-408e-b799-299e44328b4f" containerID="8aa4269ad04c105f09c29b6f6eed542dfd65d6118a3d56cb4e80acb23f0984e6" exitCode=255
Oct 31 07:28:01.943368 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.943303    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" event={"ID":"ccea0fe7-8780-408e-b799-299e44328b4f","Type":"ContainerDied","Data":"8aa4269ad04c105f09c29b6f6eed542dfd65d6118a3d56cb4e80acb23f0984e6"}
Oct 31 07:28:01.943368 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.943361    2575 scope.go:122] "RemoveContainer" containerID="a4dbf7c967f5a459468d1e4168bbcbe31dc3029f0b1019934fce47bf9a520d40"
Oct 31 07:28:01.943800 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.943781    2575 scope.go:122] "RemoveContainer" containerID="8aa4269ad04c105f09c29b6f6eed542dfd65d6118a3d56cb4e80acb23f0984e6"
Oct 31 07:28:01.944294 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.944031    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-bqnjc_openshift-console-operator(ccea0fe7-8780-408e-b799-299e44328b4f)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" podUID="ccea0fe7-8780-408e-b799-299e44328b4f"
Oct 31 07:28:01.947616 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.947080    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg" event={"ID":"9a46a25a-59fe-4cd2-8566-4203c84b5175","Type":"ContainerStarted","Data":"ba12f433a098e03bff7e7d3b6483251ebffe25c766778afc4ef93a128de4c6ed"}
Oct 31 07:28:01.951488 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.951094    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mtrsf" event={"ID":"647db033-e901-4100-b8a0-a60948730917","Type":"ContainerStarted","Data":"5e4d62276528ab2930ad4c14fadaa75208151feea846772709065bd3d096279b"}
Oct 31 07:28:01.951488 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.951162    2575 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:28:01.953074 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.953047    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rw59c" event={"ID":"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec","Type":"ContainerStarted","Data":"df8962dfb08c533cc82cce244aea574c928b6022a228140a7c768def39fbf843"}
Oct 31 07:28:01.983180 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.982544    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.983180 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:01.982711    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:01.983180 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.982978    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 07:28:01.983180 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.983041    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:02.983024039 +0000 UTC m=+39.971166571 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : configmap "kube-rbac-proxy" not found
Oct 31 07:28:01.983180 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.983115    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:01.983180 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:01.983147    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:02.983137142 +0000 UTC m=+39.971279675 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:02.024353 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.023435    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-t6jrq-6cxmm"]
Oct 31 07:28:02.026531 ip-10-0-128-20 kubenswrapper[2575]: W1031 07:28:02.026494    2575 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad965044_2fab_47cf_935d_47121860352c.slice/crio-f590b572ae403562acb55a707e1a8580bd38d13a42ca3387f5238b7046b6498f WatchSource:0}: Error finding container f590b572ae403562acb55a707e1a8580bd38d13a42ca3387f5238b7046b6498f: Status 404 returned error can't find the container with id f590b572ae403562acb55a707e1a8580bd38d13a42ca3387f5238b7046b6498f
Oct 31 07:28:02.065482 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.065431    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg" podStartSLOduration=394.730140484 podStartE2EDuration="6m41.065417202s" totalImagesPullingTime="6.335276718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:21:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:02.065204619 +0000 UTC m=+39.053347160" watchObservedRunningTime="2026-10-31 07:28:02.065417202 +0000 UTC m=+39.053559739"
Oct 31 07:28:02.065623 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.065556    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mtrsf" podStartSLOduration=34.273725024 podStartE2EDuration="38.065552734s" totalImagesPullingTime="3.79182771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:02.026399753 +0000 UTC m=+39.014542294" watchObservedRunningTime="2026-10-31 07:28:02.065552734 +0000 UTC m=+39.053695273"
Oct 31 07:28:02.086428 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.086394    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:02.086652 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:02.086632    2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 07:28:02.086787 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:02.086697    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls podName:e248978c-acdb-47f0-b702-c0029711230d nodeName:}" failed. No retries permitted until 2026-10-31 07:28:10.086677001 +0000 UTC m=+47.074819519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls") pod "dns-default-b4zz8" (UID: "e248978c-acdb-47f0-b702-c0029711230d") : secret "dns-default-metrics-tls" not found
Oct 31 07:28:02.110373 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.110344    2575 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-6ggm8"]
Oct 31 07:28:02.111894 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.111839    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rw59c" podStartSLOduration=2.790744451 podStartE2EDuration="9.111820245s" totalImagesPullingTime="6.321075794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:02.109019243 +0000 UTC m=+39.097161797" watchObservedRunningTime="2026-10-31 07:28:02.111820245 +0000 UTC m=+39.099962785"
Oct 31 07:28:02.289064 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.287132    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:02.962762 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.962720    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8" event={"ID":"d8753ed2-8968-47dc-aae5-6abc034f7435","Type":"ContainerStarted","Data":"4e83ef84873c08ae7729976048d80d2d3ce3afbec9d13245192a1876de8a3b2a"}
Oct 31 07:28:02.963233 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.962784    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8" event={"ID":"d8753ed2-8968-47dc-aae5-6abc034f7435","Type":"ContainerStarted","Data":"5ba03c82d5eb1ef3661ef3613864e3109711ef9277c8abd3909af1fb22ab659d"}
Oct 31 07:28:02.967190 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.966298    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:28:02.967190 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.966725    2575 scope.go:122] "RemoveContainer" containerID="8aa4269ad04c105f09c29b6f6eed542dfd65d6118a3d56cb4e80acb23f0984e6"
Oct 31 07:28:02.967190 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:02.966888    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-bqnjc_openshift-console-operator(ccea0fe7-8780-408e-b799-299e44328b4f)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" podUID="ccea0fe7-8780-408e-b799-299e44328b4f"
Oct 31 07:28:02.972975 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.971545    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm" event={"ID":"ad965044-2fab-47cf-935d-47121860352c","Type":"ContainerStarted","Data":"b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb"}
Oct 31 07:28:02.972975 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:02.971581    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm" event={"ID":"ad965044-2fab-47cf-935d-47121860352c","Type":"ContainerStarted","Data":"f590b572ae403562acb55a707e1a8580bd38d13a42ca3387f5238b7046b6498f"}
Oct 31 07:28:03.006469 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.002403    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:03.006469 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.002577    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:03.006469 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:03.002723    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:03.006469 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:03.002784    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:05.00276546 +0000 UTC m=+41.990907993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:03.006469 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:03.002830    2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Oct 31 07:28:03.006469 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:03.002859    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:05.002849741 +0000 UTC m=+41.990992272 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : configmap "kube-rbac-proxy" not found
Oct 31 07:28:03.006469 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.005501    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8" podStartSLOduration=2.0054857 podStartE2EDuration="2.0054857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:03.003453279 +0000 UTC m=+39.991595819" watchObservedRunningTime="2026-10-31 07:28:03.0054857 +0000 UTC m=+39.993628243"
Oct 31 07:28:03.050150 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.048527    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm" podStartSLOduration=2.048506872 podStartE2EDuration="2.048506872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:03.048047627 +0000 UTC m=+40.036190173" watchObservedRunningTime="2026-10-31 07:28:03.048506872 +0000 UTC m=+40.036649415"
Oct 31 07:28:03.052220 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.052162    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:03.248162 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.248109    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:03.360633 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.360559    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:03.715170 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.715120    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:03.824486 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.824441    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:03.938039 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.938004    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:03.976197 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.976114    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp" event={"ID":"6330753d-1f92-46d9-a1ff-70262d02c414","Type":"ContainerStarted","Data":"08e73f90b24bb550cd192be7cbbce7bca34c685c25cf9e26621f44b2c44a88b6"}
Oct 31 07:28:03.978126 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:03.978089    2575 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9" event={"ID":"aec5e525-a7f4-460d-aceb-f8412e0c3b2b","Type":"ContainerStarted","Data":"09591a3ab79267705cdc3406072a82ba59c5dd46628d2e21e98cc5e8034c699e"}
Oct 31 07:28:04.018601 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:04.018535    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp" podStartSLOduration=1.9261404930000001 podStartE2EDuration="4.018517956s" totalImagesPullingTime="2.092377463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:04.017878693 +0000 UTC m=+41.006021234" watchObservedRunningTime="2026-10-31 07:28:04.018517956 +0000 UTC m=+41.006660535"
Oct 31 07:28:04.057380 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:04.057327    2575 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9" podStartSLOduration=1.928093659 podStartE2EDuration="4.057311241s" totalImagesPullingTime="2.129217582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:28:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:04.055812648 +0000 UTC m=+41.043955188" watchObservedRunningTime="2026-10-31 07:28:04.057311241 +0000 UTC m=+41.045453815"
Oct 31 07:28:04.397989 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:04.397898    2575 kubelet.go:2727] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:04.398435 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:04.398417    2575 scope.go:122] "RemoveContainer" containerID="8aa4269ad04c105f09c29b6f6eed542dfd65d6118a3d56cb4e80acb23f0984e6"
Oct 31 07:28:04.398678 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:04.398654    2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7cd56b8dbc-bqnjc_openshift-console-operator(ccea0fe7-8780-408e-b799-299e44328b4f)\"" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" podUID="ccea0fe7-8780-408e-b799-299e44328b4f"
Oct 31 07:28:04.543604 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:04.543573    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzt8h_408136c3-732d-4564-a1f8-c969888f361d/dns-node-resolver/0.log"
Oct 31 07:28:04.907157 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:04.907121    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:05.016648 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:05.016617    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:05.024966 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:05.024907    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:05.025120 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:05.025074    2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:05.025216 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:05.025200    2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:05.025299 ip-10-0-128-20 kubenswrapper[2575]: E1031 07:28:05.025287    2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:09.025269503 +0000 UTC m=+46.013412026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:05.025521 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:05.025501    2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:05.264868 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:05.264836    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:05.349029 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:05.349000    2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8498p_f2d1eb29-7f18-41ee-949d-33892c4b30c1/node-ca/0.log"
Oct 31 07:28:05.382149 ip-10-0-128-20 kubenswrapper[2575]: I1031 07:28:05.382116    2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:05.396160 ip-10-0-128-20 systemd[1]: Stopping Kubernetes Kubelet...
Oct 31 07:28:05.415332 ip-10-0-128-20 systemd[1]: kubelet.service: Deactivated successfully.
Oct 31 07:28:05.415506 ip-10-0-128-20 systemd[1]: Stopped Kubernetes Kubelet.
Oct 31 07:28:05.415688 ip-10-0-128-20 systemd[1]: kubelet.service: Consumed 3.307s CPU time.
Oct 31 07:28:05.429587 ip-10-0-128-20 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 07:28:05.530227 ip-10-0-128-20 kubenswrapper[5039]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:28:05.530227 ip-10-0-128-20 kubenswrapper[5039]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 07:28:05.530227 ip-10-0-128-20 kubenswrapper[5039]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:28:05.530227 ip-10-0-128-20 kubenswrapper[5039]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 07:28:05.532376 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532279    5039 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:05.532376 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532375    5039 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:05.532376 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532379    5039 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532383    5039 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532386    5039 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532389    5039 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532392    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532394    5039 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532397    5039 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532400    5039 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532402    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532405    5039 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532408    5039 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532410    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532413    5039 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532418    5039 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532423    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532426    5039 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532430    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532433    5039 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532437    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:05.532485 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532443    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532446    5039 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532449    5039 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532453    5039 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532457    5039 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532461    5039 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532464    5039 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532467    5039 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532471    5039 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532473    5039 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532477    5039 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532480    5039 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532483    5039 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532486    5039 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532489    5039 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532492    5039 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532495    5039 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532498    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532501    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:05.532981 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532504    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532506    5039 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532509    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532512    5039 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532515    5039 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532518    5039 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532520    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532523    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532526    5039 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532528    5039 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532531    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532534    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532537    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532539    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532543    5039 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532545    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532548    5039 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532551    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532553    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:05.533443 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532556    5039 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532559    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532561    5039 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532563    5039 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532566    5039 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532570    5039 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532573    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532576    5039 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532578    5039 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532581    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532584    5039 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532586    5039 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532589    5039 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532592    5039 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532595    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532597    5039 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532600    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532603    5039 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532606    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532609    5039 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:05.533904 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532611    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532614    5039 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532616    5039 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532619    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532622    5039 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532624    5039 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532627    5039 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532630    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532632    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532635    5039 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532637    5039 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532640    5039 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532642    5039 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532645    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532647    5039 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532650    5039 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532653    5039 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532655    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532658    5039 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:05.534451 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532661    5039 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532664    5039 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532667    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532670    5039 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532673    5039 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532675    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532678    5039 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.532681    5039 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533523    5039 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533532    5039 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533536    5039 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533539    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533542    5039 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533545    5039 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533547    5039 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533550    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533553    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533556    5039 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533558    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:05.534930 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533561    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533563    5039 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533567    5039 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533569    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533572    5039 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533574    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533577    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533580    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533582    5039 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533585    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533588    5039 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533590    5039 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533594    5039 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533598    5039 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533602    5039 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533606    5039 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533609    5039 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533611    5039 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533615    5039 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:05.535404 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533617    5039 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533620    5039 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533632    5039 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533635    5039 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533638    5039 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533641    5039 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533643    5039 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533649    5039 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533652    5039 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533655    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533658    5039 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533660    5039 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533663    5039 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533666    5039 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533668    5039 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533671    5039 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533673    5039 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533676    5039 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533678    5039 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533681    5039 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:05.535935 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533684    5039 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533687    5039 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533689    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533692    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533695    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533697    5039 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533700    5039 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533703    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533705    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533708    5039 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533710    5039 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533713    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533716    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533719    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533722    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533725    5039 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533728    5039 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533730    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533733    5039 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:05.536439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533737    5039 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533739    5039 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533742    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533745    5039 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533747    5039 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533750    5039 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533752    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533755    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533758    5039 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533761    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533763    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533766    5039 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533768    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533771    5039 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533774    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533777    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533780    5039 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533783    5039 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533785    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533788    5039 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:05.536972 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533790    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533793    5039 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533795    5039 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533798    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533801    5039 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533803    5039 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533806    5039 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533810    5039 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533813    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533816    5039 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533819    5039 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533821    5039 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533826    5039 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533829    5039 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533831    5039 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533834    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.533836    5039 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534358    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534363    5039 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534366    5039 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:05.537490 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534369    5039 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534372    5039 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534375    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534377    5039 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534380    5039 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534383    5039 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534386    5039 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534388    5039 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534391    5039 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534394    5039 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534396    5039 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534399    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534401    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534404    5039 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534406    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534410    5039 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534413    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534416    5039 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534418    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534421    5039 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:05.538005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534423    5039 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534427    5039 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534430    5039 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534432    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534436    5039 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534439    5039 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534441    5039 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534444    5039 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534447    5039 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534449    5039 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534452    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534455    5039 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534458    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534460    5039 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534463    5039 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534466    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534468    5039 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534471    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534474    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534476    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:05.538523 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534479    5039 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534482    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534485    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534487    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534492    5039 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534495    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534498    5039 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534501    5039 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534503    5039 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534506    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534509    5039 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534511    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534514    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534516    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534519    5039 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534522    5039 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534525    5039 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534528    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534530    5039 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:05.539293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534533    5039 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534536    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534539    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534541    5039 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534544    5039 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534547    5039 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534549    5039 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534552    5039 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534554    5039 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534557    5039 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534560    5039 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534562    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534565    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534569    5039 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534573    5039 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534576    5039 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534578    5039 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534581    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534584    5039 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:05.539907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534586    5039 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534589    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534592    5039 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534594    5039 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534597    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534599    5039 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534602    5039 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534605    5039 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534607    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534610    5039 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534613    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534616    5039 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534619    5039 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534625    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534628    5039 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534631    5039 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534633    5039 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534636    5039 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534639    5039 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534642    5039 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:05.540406 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534646    5039 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534650    5039 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534653    5039 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534655    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.534658    5039 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534754    5039 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534762    5039 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534768    5039 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534773    5039 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534778    5039 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534781    5039 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534786    5039 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534790    5039 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534793    5039 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534796    5039 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534800    5039 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534804    5039 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534807    5039 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534810    5039 flags.go:64] FLAG: --cgroup-root=""
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534813    5039 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534816    5039 flags.go:64] FLAG: --client-ca-file=""
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534819    5039 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534824    5039 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534829    5039 flags.go:64] FLAG: --cluster-domain=""
Oct 31 07:28:05.540906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534832    5039 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534837    5039 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534841    5039 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534845    5039 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534849    5039 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534853    5039 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534856    5039 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534860    5039 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534863    5039 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534866    5039 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534869    5039 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534873    5039 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534876    5039 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534881    5039 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534885    5039 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534888    5039 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534891    5039 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534894    5039 flags.go:64] FLAG: --enable-server="true"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534897    5039 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534902    5039 flags.go:64] FLAG: --event-burst="100"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534905    5039 flags.go:64] FLAG: --event-qps="50"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534908    5039 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534926    5039 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534930    5039 flags.go:64] FLAG: --eviction-hard=""
Oct 31 07:28:05.541520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534935    5039 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534940    5039 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534944    5039 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534947    5039 flags.go:64] FLAG: --eviction-soft=""
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534950    5039 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534953    5039 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534956    5039 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534960    5039 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534963    5039 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534967    5039 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534970    5039 flags.go:64] FLAG: --feature-gates=""
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534974    5039 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534978    5039 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534981    5039 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534984    5039 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534987    5039 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534991    5039 flags.go:64] FLAG: --help="false"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534994    5039 flags.go:64] FLAG: --hostname-override="ip-10-0-128-20.ec2.internal"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.534998    5039 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535001    5039 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535004    5039 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535007    5039 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535011    5039 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535014    5039 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 07:28:05.542126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535016    5039 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535019    5039 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535022    5039 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535025    5039 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535028    5039 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535031    5039 flags.go:64] FLAG: --kube-reserved=""
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535034    5039 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535037    5039 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535040    5039 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535045    5039 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535048    5039 flags.go:64] FLAG: --lock-file=""
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535052    5039 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535055    5039 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535058    5039 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535064    5039 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535067    5039 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535071    5039 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535075    5039 flags.go:64] FLAG: --logging-format="text"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535078    5039 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535081    5039 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535084    5039 flags.go:64] FLAG: --manifest-url=""
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535087    5039 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535092    5039 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535095    5039 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535099    5039 flags.go:64] FLAG: --max-pods="110"
Oct 31 07:28:05.542767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535102    5039 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535105    5039 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535108    5039 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535111    5039 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535114    5039 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535117    5039 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535120    5039 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535127    5039 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535131    5039 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535134    5039 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535137    5039 flags.go:64] FLAG: --pod-cidr=""
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535140    5039 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535143    5039 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535146    5039 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535149    5039 flags.go:64] FLAG: --port="10250"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535152    5039 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535160    5039 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aa70f34d871de152"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535163    5039 flags.go:64] FLAG: --qos-reserved=""
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535166    5039 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535170    5039 flags.go:64] FLAG: --register-node="true"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535173    5039 flags.go:64] FLAG: --register-with-taints=""
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535177    5039 flags.go:64] FLAG: --registry-burst="10"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535180    5039 flags.go:64] FLAG: --registry-qps="5"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535183    5039 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535186    5039 flags.go:64] FLAG: --reserved-memory=""
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535191    5039 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 07:28:05.543384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535194    5039 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535197    5039 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535200    5039 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535203    5039 flags.go:64] FLAG: --runonce="false"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535206    5039 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535209    5039 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535212    5039 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535215    5039 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535218    5039 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535221    5039 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535224    5039 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535227    5039 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535230    5039 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535233    5039 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535236    5039 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535239    5039 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535242    5039 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535245    5039 flags.go:64] FLAG: --system-cgroups=""
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535248    5039 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535253    5039 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535256    5039 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535259    5039 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535265    5039 flags.go:64] FLAG: --tls-min-version=""
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535268    5039 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535271    5039 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 07:28:05.544061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535275    5039 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535278    5039 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535281    5039 flags.go:64] FLAG: --v="2"
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535285    5039 flags.go:64] FLAG: --version="false"
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535289    5039 flags.go:64] FLAG: --vmodule=""
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535294    5039 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535298    5039 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535442    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535446    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535449    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535454    5039 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535457    5039 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535460    5039 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535463    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535466    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535469    5039 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535471    5039 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535474    5039 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535476    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535479    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535482    5039 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:05.544721 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535485    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535488    5039 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535490    5039 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535493    5039 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535496    5039 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535498    5039 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535501    5039 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535504    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535509    5039 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535511    5039 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535514    5039 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535517    5039 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535519    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535522    5039 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535525    5039 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535527    5039 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535530    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535534    5039 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535538    5039 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:05.545269 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535541    5039 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535544    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535549    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535551    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535554    5039 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535557    5039 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535559    5039 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535562    5039 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535565    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535568    5039 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535570    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535573    5039 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535576    5039 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535578    5039 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535581    5039 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535583    5039 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535586    5039 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535589    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535591    5039 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535594    5039 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:05.545745 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535597    5039 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535600    5039 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535603    5039 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535606    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535608    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535611    5039 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535614    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535616    5039 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535619    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535621    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535624    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535626    5039 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535629    5039 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535633    5039 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535636    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535639    5039 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535642    5039 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535645    5039 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535648    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:05.546307 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535650    5039 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535653    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535656    5039 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535658    5039 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535661    5039 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535663    5039 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535666    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535669    5039 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535671    5039 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535674    5039 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535677    5039 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535680    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535682    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535685    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535689    5039 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535691    5039 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535694    5039 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535697    5039 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535700    5039 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535704    5039 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:05.546812 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535707    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535710    5039 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535713    5039 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535715    5039 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535718    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535720    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535723    5039 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535727    5039 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535730    5039 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535733    5039 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535735    5039 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535738    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535741    5039 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535743    5039 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.535779    5039 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535820    5039 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:05.547321 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535825    5039 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535828    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535833    5039 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535854    5039 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535857    5039 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535861    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535864    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535866    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535869    5039 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535872    5039 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535875    5039 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535878    5039 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535881    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535884    5039 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535887    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535890    5039 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535893    5039 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535895    5039 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535898    5039 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:05.547756 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535900    5039 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535903    5039 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535906    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535908    5039 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535925    5039 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535932    5039 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535936    5039 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535941    5039 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535945    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535950    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535955    5039 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535959    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535962    5039 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535965    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535967    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535970    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535972    5039 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535975    5039 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535978    5039 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:05.548293 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535980    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535983    5039 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535986    5039 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535989    5039 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535993    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535996    5039 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.535999    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536001    5039 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536004    5039 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536007    5039 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536010    5039 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536012    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536015    5039 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536017    5039 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536020    5039 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536023    5039 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536025    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536028    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536033    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536036    5039 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:05.548765 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536039    5039 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536041    5039 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536044    5039 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536047    5039 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536051    5039 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536054    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536057    5039 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536059    5039 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536062    5039 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536065    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536067    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536070    5039 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536072    5039 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536075    5039 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536078    5039 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536080    5039 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536086    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536089    5039 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536092    5039 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536094    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:05.549277 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536097    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536100    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536102    5039 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536105    5039 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536108    5039 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536110    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536113    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536115    5039 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536118    5039 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536120    5039 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536124    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536128    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536130    5039 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536133    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536136    5039 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536138    5039 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536141    5039 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536144    5039 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536146    5039 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:05.549815 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536150    5039 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536153    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536155    5039 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536158    5039 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536161    5039 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536163    5039 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536166    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.536168    5039 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.541073    5039 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.541091    5039 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.541112    5039 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.541117    5039 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541178    5039 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541184    5039 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541187    5039 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541191    5039 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541195    5039 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541200    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541203    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:05.550299 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541207    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541210    5039 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541213    5039 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541215    5039 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541219    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541221    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541224    5039 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541227    5039 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541230    5039 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541233    5039 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541235    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541238    5039 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541240    5039 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541243    5039 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541247    5039 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541252    5039 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541255    5039 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541258    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541261    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:05.550761 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541265    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541271    5039 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541274    5039 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541277    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541280    5039 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541283    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541285    5039 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541288    5039 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541290    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541293    5039 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541296    5039 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541299    5039 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541301    5039 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541304    5039 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541307    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541309    5039 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541312    5039 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541315    5039 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541317    5039 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:05.551428 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541320    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541322    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541325    5039 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541327    5039 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541330    5039 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541333    5039 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541336    5039 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541339    5039 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541341    5039 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541344    5039 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541347    5039 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541350    5039 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541352    5039 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541355    5039 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541358    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541361    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541364    5039 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541366    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541369    5039 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541372    5039 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:05.551923 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541375    5039 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541377    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541380    5039 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541382    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541385    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541388    5039 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541390    5039 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541393    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541395    5039 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541398    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541401    5039 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541403    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541406    5039 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541408    5039 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541411    5039 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541414    5039 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541417    5039 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541419    5039 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541422    5039 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541424    5039 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:05.552414 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541427    5039 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541430    5039 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541433    5039 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541435    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541438    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541440    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541443    5039 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541445    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541449    5039 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541451    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541454    5039 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541457    5039 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541459    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541462    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541464    5039 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541467    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541469    5039 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541472    5039 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541474    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:05.552891 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541477    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541480    5039 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.541509    5039 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541653    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541658    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541661    5039 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541663    5039 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541666    5039 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541669    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541672    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541675    5039 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541678    5039 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541680    5039 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541683    5039 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541685    5039 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541688    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:05.553439 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541691    5039 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541693    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541696    5039 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541698    5039 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541701    5039 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541704    5039 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541706    5039 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541709    5039 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541711    5039 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541714    5039 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541717    5039 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541720    5039 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541723    5039 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541725    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541729    5039 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541734    5039 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541737    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541739    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541742    5039 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541745    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:05.553860 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541748    5039 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541750    5039 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541753    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541756    5039 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541758    5039 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541762    5039 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541764    5039 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541767    5039 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541770    5039 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541773    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541776    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541778    5039 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541781    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541783    5039 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541786    5039 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541789    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541791    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541794    5039 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541796    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:05.554390 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541799    5039 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541802    5039 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541804    5039 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541807    5039 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541810    5039 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541812    5039 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541815    5039 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541817    5039 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541820    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541822    5039 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541825    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541827    5039 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541830    5039 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541832    5039 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541835    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541837    5039 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541840    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541843    5039 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541845    5039 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:05.555057 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541849    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541851    5039 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541854    5039 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541857    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541860    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541862    5039 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541865    5039 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541867    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541870    5039 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541874    5039 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541878    5039 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541881    5039 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541884    5039 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541887    5039 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541890    5039 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541893    5039 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541895    5039 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541898    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541900    5039 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:05.555773 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541903    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541906    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541908    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541911    5039 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541933    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541937    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541941    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541945    5039 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541949    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541952    5039 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541955    5039 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541958    5039 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541961    5039 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541964    5039 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541967    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.541970    5039 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:05.556556 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.541996    5039 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542029    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542033    5039 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542036    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542039    5039 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542042    5039 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542045    5039 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542048    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542050    5039 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542053    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542056    5039 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542058    5039 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542061    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542064    5039 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542066    5039 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542069    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542072    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542074    5039 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542077    5039 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 07:28:05.557303 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542080    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542082    5039 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542086    5039 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542090    5039 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542093    5039 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542102    5039 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542106    5039 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542108    5039 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542111    5039 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542114    5039 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542116    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542119    5039 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542122    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542125    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542128    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542130    5039 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542133    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542136    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542139    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542142    5039 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 07:28:05.557813 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542145    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542147    5039 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542150    5039 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542153    5039 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542155    5039 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542158    5039 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542164    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542167    5039 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542170    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542173    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542175    5039 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542178    5039 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542181    5039 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542183    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542186    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542188    5039 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542191    5039 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542195    5039 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542198    5039 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542200    5039 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 07:28:05.558364 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542203    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542206    5039 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542208    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542211    5039 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542214    5039 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542217    5039 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542220    5039 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542222    5039 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542225    5039 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542228    5039 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542230    5039 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542233    5039 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542236    5039 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542238    5039 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542241    5039 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542245    5039 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542249    5039 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542252    5039 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542256    5039 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542259    5039 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 07:28:05.558879 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542261    5039 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542264    5039 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542267    5039 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542270    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542273    5039 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542275    5039 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542278    5039 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542281    5039 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542284    5039 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542288    5039 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542291    5039 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542293    5039 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542296    5039 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542299    5039 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542302    5039 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542305    5039 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542307    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542310    5039 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542314    5039 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 07:28:05.559396 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542317    5039 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542319    5039 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542322    5039 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542325    5039 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542329    5039 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542331    5039 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542334    5039 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542336    5039 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:05.542339    5039 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.542410    5039 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.543605    5039 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.543693    5039 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.543985    5039 server.go:1014] "Starting client certificate rotation"
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.544132    5039 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.544182    5039 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 07:22:24 +0000 UTC" deadline="2028-06-14 21:43:22.252661534 +0000 UTC"
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.544222    5039 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14222h15m16.70844176s"
Oct 31 07:28:05.559871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.544693    5039 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 07:28:05.560294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.545834    5039 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 07:28:05.560294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.547027    5039 log.go:25] "Validated CRI v1 runtime API"
Oct 31 07:28:05.560294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.548725    5039 log.go:25] "Validated CRI v1 image API"
Oct 31 07:28:05.560294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.549443    5039 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 07:28:05.560294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.551836    5039 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b477b2ee-eeae-4abf-90c3-c9391bb3ecda:/dev/nvme0n1p3 eb8ed6a1-fd26-48ee-bb7b-279f852bcf7b:/dev/nvme0n1p4]
Oct 31 07:28:05.560462 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.551859    5039 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0192053c48aef8c4e7de04c639b6fda6ce44e1f931fd7bc4b5414f2125bd02b1/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0192053c48aef8c4e7de04c639b6fda6ce44e1f931fd7bc4b5414f2125bd02b1/userdata/shm major:0 minor:246 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/03abbf752528aad256d10130a09b5a61f64d5aee71acc0f5363694e9dfe89d36/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/03abbf752528aad256d10130a09b5a61f64d5aee71acc0f5363694e9dfe89d36/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/08b9f307ff09d585a8d221810ce84a6fb2c2fe8b386d59ff55086576e5db9ae2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/08b9f307ff09d585a8d221810ce84a6fb2c2fe8b386d59ff55086576e5db9ae2/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2c29d7fa71c62cdece9daae0eda413e926bdaa81da35325cc86d337d0800a7fd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2c29d7fa71c62cdece9daae0eda413e926bdaa81da35325cc86d337d0800a7fd/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/300dbf94145c0562b44cc2e4dacd91cd5d4e6537f17608eaa5fadcf843a3ed79/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/300dbf94145c0562b44cc2e4dacd91cd5d4e6537f17608eaa5fadcf843a3ed79/userdata/shm major:0 minor:89 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/537c42ce1bf48532262d5c2d266a88d8b3caefa21ae68011c71bbdff8b8e146b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/537c42ce1bf48532262d5c2d266a88d8b3caefa21ae68011c71bbdff8b8e146b/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5ba03c82d5eb1ef3661ef3613864e3109711ef9277c8abd3909af1fb22ab659d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5ba03c82d5eb1ef3661ef3613864e3109711ef9277c8abd3909af1fb22ab659d/userdata/shm major:0 minor:342 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/626292732b189f0a88531cf479737061bf352473bfc57ead302dd6f7ea19e083/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/626292732b189f0a88531cf479737061bf352473bfc57ead302dd6f7ea19e083/userdata/shm major:0 minor:231 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/6c81d44f5390e022b44db75eca8b84f82eebec773b2479f861ff781cda6818e4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/6c81d44f5390e022b44db75eca8b84f82eebec773b2479f861ff781cda6818e4/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/78cee45ff085d114a5ed0c7d97cb295a14ddc15f810dd71334dcf9eee3fa5687/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/78cee45ff085d114a5ed0c7d97cb295a14ddc15f810dd71334dcf9eee3fa5687/userdata/shm major:0 minor:237 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7c35edefa2c76448c64ca8bc46ca6c176e28c0fd43830dce6d7d567666e59657/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7c35edefa2c76448c64ca8bc46ca6c176e28c0fd43830dce6d7d567666e59657/userdata/shm major:0 minor:293 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8a16c8bad71aa477555a9bec2f2efd79bf271f4e7d0d06d7ce161bb37aecdb31/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8a16c8bad71aa477555a9bec2f2efd79bf271f4e7d0d06d7ce161bb37aecdb31/userdata/shm major:0 minor:322 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/90d1896322dcee73dc3b1735a7e273d95193ec4cad4c28746be58079f00a4be8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/90d1896322dcee73dc3b1735a7e273d95193ec4cad4c28746be58079f00a4be8/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/93fbf2f3d9d06aeef147be5d9729517950f9ef4d107aa8023aaa58497e470f98/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/93fbf2f3d9d06aeef147be5d9729517950f9ef4d107aa8023aaa58497e470f98/userdata/shm major:0 minor:82 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9f3e973fbb857b823585edb8f7e3ebf0ddb14a380d9b0ec9aaca95bd3276082d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9f3e973fbb857b823585edb8f7e3ebf0ddb14a380d9b0ec9aaca95bd3276082d/userdata/shm major:0 minor:233 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a6ef01d3e3777e37ed95d0089348f8ee457f4c6345bd089d16c72dbfc3f0f6a2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a6ef01d3e3777e37ed95d0089348f8ee457f4c6345bd089d16c72dbfc3f0f6a2/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b9d6d79758591128284893b48d027583ff81a05dd4af58a8120f9e196dcbc98a/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b9d6d79758591128284893b48d027583ff81a05dd4af58a8120f9e196dcbc98a/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c091275e6be81bd30a74f28e7de057b145f8e7be78d03bb64fe99292c565b4ee/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c091275e6be81bd30a74f28e7de057b145f8e7be78d03bb64fe99292c565b4ee/userdata/shm major:0 minor:69 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c8c0dc0861d65b0145f2bd4ff977609829a728df3f1c28f7468aec8d6abb228e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c8c0dc0861d65b0145f2bd4ff977609829a728df3f1c28f7468aec8d6abb228e/userdata/shm major:0 minor:243 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ca784faed0f673b74424fbbbd118c54ef9e1b28687a59cd61e1a94de3f15eb4e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ca784faed0f673b74424fbbbd118c54ef9e1b28687a59cd61e1a94de3f15eb4e/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d48935d7e4d6b565b145e60988db297a1639ea3ef86ec35e0f2135190f35dffa/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d48935d7e4d6b565b145e60988db297a1639ea3ef86ec35e0f2135190f35dffa/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ddb7f8f4c8b171aaff7ea88759f6199e086e6567ff926dbd4d4eb906f8451386/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ddb7f8f4c8b171aaff7ea88759f6199e086e6567ff926dbd4d4eb906f8451386/userdata/shm major:0 minor:235 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e3bb7d9d6ee1f636bc108e8694142b265f73a06a535518460a0f3368271bf954/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e3bb7d9d6ee1f636bc108e8694142b265f73a06a535518460a0f3368271bf954/userdata/shm major:0 minor:242 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ec622f400d3a5ffc6f5a88d6919723990928b601e9028d3ea20ea036dfece44e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ec622f400d3a5ffc6f5a88d6919723990928b601e9028d3ea20ea036dfece44e/userdata/shm major:0 minor:324 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f52400aca8e99b03ee91be055f11689304165f4ed69cce0796c8ad8768c73e60/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f52400aca8e99b03ee91be055f11689304165f4ed69cce0796c8ad8768c73e60/userdata/shm major:0 minor:229 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f590b572ae403562acb55a707e1a8580bd38d13a42ca3387f5238b7046b6498f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f590b572ae403562acb55a707e1a8580bd38d13a42ca3387f5238b7046b6498f/userdata/shm major:0 minor:339 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/06e7dac1-d91c-4928-bbca-a4d1535e2170/volumes/kubernetes.io~projected/kube-api-access-lrmzs:{mountpoint:/var/lib/kubelet/pods/06e7dac1-d91c-4928-bbca-a4d1535e2170/volumes/kubernetes.io~projected/kube-api-access-lrmzs major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/078fdc95-76b1-4323-9985-905f939dbbc4/volumes/kubernetes.io~projected/kube-api-access-lvs8d:{mountpoint:/var/lib/kubelet/pods/078fdc95-76b1-4323-9985-905f939dbbc4/volumes/kubernetes.io~projected/kube-api-access-lvs8d major:0 minor:227 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/21fea0a5-efb9-4b1a-b561-d173b3ad6169/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/21fea0a5-efb9-4b1a-b561-d173b3ad6169/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/25eb80fc-fccc-4c7e-8e18-21d4afc76c55/volumes/kubernetes.io~projected/kube-api-access-rd52j:{mountpoint:/var/lib/kubelet/pods/25eb80fc-fccc-4c7e-8e18-21d4afc76c55/volumes/kubernetes.io~projected/kube-api-access-rd52j major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/29654c5b-afac-4935-b729-3e5b5c8adf50/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/29654c5b-afac-4935-b729-3e5b5c8adf50/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/29654c5b-afac-4935-b729-3e5b5c8adf50/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/29654c5b-afac-4935-b729-3e5b5c8adf50/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/29654c5b-afac-4935-b729-3e5b5c8adf50/volumes/kubernetes.io~projected/kube-api-access-g4vtt:{mountpoint:/var/lib/kubelet/pods/29654c5b-afac-4935-b729-3e5b5c8adf50/volumes/kubernetes.io~projected/kube-api-access-g4vtt major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/volumes/kubernetes.io~projected/kube-api-access-7775h:{mountpoint:/var/lib/kubelet/pods/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/volumes/kubernetes.io~projected/kube-api-access-7775h major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/408136c3-732d-4564-a1f8-c969888f361d/volumes/kubernetes.io~projected/kube-api-access-24qkk:{mountpoint:/var/lib/kubelet/pods/408136c3-732d-4564-a1f8-c969888f361d/volumes/kubernetes.io~projected/kube-api-access-24qkk major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/volumes/kubernetes.io~projected/kube-api-access-prvpd:{mountpoint:/var/lib/kubelet/pods/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/volumes/kubernetes.io~projected/kube-api-access-prvpd major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/volumes/kubernetes.io~secret/default-certificate:{mountpoint:/var/lib/kubelet/pods/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/volumes/kubernetes.io~secret/default-certificate major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/volumes/kubernetes.io~secret/stats-auth:{mountpoint:/var/lib/kubelet/pods/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/volumes/kubernetes.io~secret/stats-auth major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4167bdf8-9b23-482d-805f-c6fdeeda5384/volumes/kubernetes.io~projected/kube-api-access-k4kdq:{mountpoint:/var/lib/kubelet/pods/4167bdf8-9b23-482d-805f-c6fdeeda5384/volumes/kubernetes.io~projected/kube-api-access-k4kdq major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4820d461-a6e0-49fe-a57c-dbff7bc255f8/volumes/kubernetes.io~projected/kube-api-access-mrxr9:{mountpoint:/var/lib/kubelet/pods/4820d461-a6e0-49fe-a57c-dbff7bc255f8/volumes/kubernetes.io~projected/kube-api-access-mrxr9 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/508a0686-e4c7-472a-b608-d270a7dbce3d/volumes/kubernetes.io~projected/kube-api-access-nsx85:{mountpoint:/var/lib/kubelet/pods/508a0686-e4c7-472a-b608-d270a7dbce3d/volumes/kubernetes.io~projected/kube-api-access-nsx85 major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/513eea23-470d-4236-ae17-1666a54ce63f/volumes/kubernetes.io~projected/kube-api-access-vg8q5:{mountpoint:/var/lib/kubelet/pods/513eea23-470d-4236-ae17-1666a54ce63f/volumes/kubernetes.io~projected/kube-api-access-vg8q5 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5a3e7931-f6a9-419d-8cce-5c884e627036/volumes/kubernetes.io~projected/kube-api-access-gk4bt:{mountpoint:/var/lib/kubelet/pods/5a3e7931-f6a9-419d-8cce-5c884e627036/volumes/kubernetes.io~projected/kube-api-access-gk4bt major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec/volumes/kubernetes.io~projected/kube-api-access-nk28k:{mountpoint:/var/lib/kubelet/pods/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec/volumes/kubernetes.io~projected/kube-api-access-nk28k major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec/volumes/kubernetes.io~secret/cert major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6330753d-1f92-46d9-a1ff-70262d02c414/volumes/kubernetes.io~projected/kube-api-access-px9bt:{mountpoint:/var/lib/kubelet/pods/6330753d-1f92-46d9-a1ff-70262d02c414/volumes/kubernetes.io~projected/kube-api-access-px9bt major:0 minor:312 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/647db033-e901-4100-b8a0-a60948730917/volumes/kubernetes.io~projected/kube-api-access-dq2z7:{mountpoint:/var/lib/kubelet/pods/647db033-e901-4100-b8a0-a60948730917/volumes/kubernetes.io~projected/kube-api-access-dq2z7 major:0 minor:295 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/680bd2c4-08ae-4e24-a6c0-37339d826971/volumes/kubernetes.io~projected/kube-api-access-bhb2p:{mountpoint:/var/lib/kubelet/pods/680bd2c4-08ae-4e24-a6c0-37339d826971/volumes/kubernetes.io~projected/kube-api-access-bhb2p major:0 minor:213 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b351b59-c90b-42cb-87b1-228f83da0488/volumes/kubernetes.io~projected/kube-api-access-hk4xv:{mountpoint:/var/lib/kubelet/pods/6b351b59-c90b-42cb-87b1-228f83da0488/volumes/kubernetes.io~projected/kube-api-access-hk4xv major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6b351b59-c90b-42cb-87b1-228f83da0488/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/6b351b59-c90b-42cb-87b1-228f83da0488/volumes/kubernetes.io~secret/serving-cert major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/71156071-2868-4bea-8ba9-20f9e073d996/volumes/kubernetes.io~projected/kube-api-access-zjfgb:{mountpoint:/var/lib/kubelet/pods/71156071-2868-4bea-8ba9-20f9e073d996/volumes/kubernetes.io~projected/kube-api-access-zjfgb major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/71156071-2868-4bea-8ba9-20f9e073d996/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/71156071-2868-4bea-8ba9-20f9e073d996/volumes/kubernetes.io~secret/serving-cert major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/735f0bbc-22c2-4f33-af0d-6fc10cda9e17/volumes/kubernetes.io~projected/kube-api-access-58wkr:{mountpoint:/var/lib/kubelet/pods/735f0bbc-22c2-4f33-af0d-6fc10cda9e17/volumes/kubernetes.io~projected/kube-api-access-58wkr major:0 minor:212 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/904b6555-9c6d-4489-9b17-0d96d5fe2c12/volumes/kubernetes.io~projected/kube-api-access-ggnwk:{mountpoint:/var/lib/kubelet/pods/904b6555-9c6d-4489-9b17-0d96d5fe2c12/volumes/kubernetes.io~projected/kube-api-access-ggnwk major:0 minor:224 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/904b6555-9c6d-4489-9b17-0d96d5fe2c12/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/904b6555-9c6d-4489-9b17-0d96d5fe2c12/volumes/kubernetes.io~secret/serving-cert major:0 minor:219 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9a46a25a-59fe-4cd2-8566-4203c84b5175/volumes/kubernetes.io~projected/kube-api-access-8f49g:{mountpoint:/var/lib/kubelet/pods/9a46a25a-59fe-4cd2-8566-4203c84b5175/volumes/kubernetes.io~projected/kube-api-access-8f49g major:0 minor:228 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:223 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~projected/kube-api-access-t2v55:{mountpoint:/var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~projected/kube-api-access-t2v55 major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:220 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a2320145-3aab-44be-a1c2-7912c2498c30/volumes/kubernetes.io~projected/kube-api-access-sbnpr:{mountpoint:/var/lib/kubelet/pods/a2320145-3aab-44be-a1c2-7912c2498c30/volumes/kubernetes.io~projected/kube-api-access-sbnpr major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb/volumes/kubernetes.io~projected/kube-api-access-46h8f:{mountpoint:/var/lib/kubelet/pods/a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb/volumes/kubernetes.io~projected/kube-api-access-46h8f major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~projected/bound-sa-token:{mountpoint:/var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~projected/bound-sa-token major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~projected/kube-api-access-t96md:{mountpoint:/var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~projected/kube-api-access-t96md major:0 minor:208 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~secret/image-registry-private-configuration:{mountpoint:/var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~secret/image-registry-private-configuration major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~secret/installation-pull-secrets:{mountpoint:/var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~secret/installation-pull-secrets major:0 minor:205 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ad965044-2fab-47cf-935d-47121860352c/volumes/kubernetes.io~projected/kube-api-access-h9kb7:{mountpoint:/var/lib/kubelet/pods/ad965044-2fab-47cf-935d-47121860352c/volumes/kubernetes.io~projected/kube-api-access-h9kb7 major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aec5e525-a7f4-460d-aceb-f8412e0c3b2b/volumes/kubernetes.io~projected/kube-api-access-stqt2:{mountpoint:/var/lib/kubelet/pods/aec5e525-a7f4-460d-aceb-f8412e0c3b2b/volumes/kubernetes.io~projected/kube-api-access-stqt2 major:0 minor:317 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccea0fe7-8780-408e-b799-299e44328b4f/volumes/kubernetes.io~projected/kube-api-access-79qlm:{mountpoint:/var/lib/kubelet/pods/ccea0fe7-8780-408e-b799-299e44328b4f/volumes/kubernetes.io~projected/kube-api-access-79qlm major:0 minor:221 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ccea0fe7-8780-408e-b799-299e44328b4f/volumes/kubernetes.io~secret/serving-cert:{mountpoint:/var/lib/kubelet/pods/ccea0fe7-8780-408e-b799-299e44328b4f/volumes/kubernetes.io~secret/serving-cert major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8753ed2-8968-47dc-aae5-6abc034f7435/volumes/kubernetes.io~projected/kube-api-access-dwvrx:{mountpoint:/var/lib/kubelet/pods/d8753ed2-8968-47dc-aae5-6abc034f7435/volumes/kubernetes.io~projected/kube-api-access-dwvrx major:0 minor:340 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d8753ed2-8968-47dc-aae5-6abc034f7435/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/d8753ed2-8968-47dc-aae5-6abc034f7435/volumes/kubernetes.io~secret/signing-key major:0 minor:336 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e248978c-acdb-47f0-b702-c0029711230d/volumes/kubernetes.io~projected/kube-api-access-4z2c6:{mountpoint:/var/lib/kubelet/pods/e248978c-acdb-47f0-b702-c0029711230d/volumes/kubernetes.io~projected/kube-api-access-4z2c6 major:0 minor:241 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/volumes/kubernetes.io~secret/agent-certs major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/f2d1eb29-7f18-41ee-949d-33892c4b30c1/volumes/kubernetes.io~projected/kube-api-access-vrth6:{mountpoint:/var/lib/kubelet/pods/f2d1eb29-7f18-41ee-949d-33892c4b30c1/volumes/kubernetes.io~projected/kube-api-access-vrth6 major:0 minor:59 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/3aaac825e88b5f1285decebd80a782cec10e32318ce5f6e055d60319fb72087a/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/2b19d287d1666191110d6fba050dfb8f9428cb748913bfb45e0c120b5d0f81ec/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/ab104f3d3e06c1fd9e3738a186db1556e040ba7a01113956ee587a793b0eb20f/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/e226a202214bf3ab89b94aca627666d2d6f326afe02d967105acf3260c08d846/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/525f4d1bca0f1fdded152ff2262e5162f623fce54150c35b0cb2c7dbe7a6c429/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/e20073cb2f9d0098eaa8a0977651c283c1b34063336441697d6d3ceed063e0e5/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/4c9481cbf3119286336cb8c0f055624780be3acf19723c636cdb917e77363b3f/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/42a80cec525d208a05ac5f5e8e369434cde03db97f014e0a9f6a0c43d07692a9/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/d54ba37aa717db9f2deebd3ff6c23f4fa016461b81ce7343803c8e76e3b0a694/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/d8a32c6da531a1d2b69c493cb68223304da259f51d5c607c70ba36c32c29a096/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-136:{mountpoint:/var/lib/containers/storage/overlay/fa97b862c58ce135b713ca2d9146c69cc45a86403f276adc3c072ef86bd9a8b2/merged major:0 minor:136 fsType:overlay blockSize:0} overlay_0-144:{mountpoint:/var/lib/containers/storage/overlay/25f62b7210c6103410afcb852afedb4a38bcc6eaace189826f99c949f28faf8b/merged major:0 minor:144 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/4717add75f60644f41c0e94591e9204ae982bcdb2e3430b0ba4cfab5440da83a/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/28d36bdc9e09879aab19a065edb383dc16293e0321c2d64390cc8dec6323c773/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-161:{mountpoint:/var/lib/containers/storage/overlay/e2d0997a888c3995f72c46b7a3e457b35065833ec753222aa7726452d98af130/merged major:0 minor:161 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/cc9d7178c96f47935f4a182f9810ca74942aefba209f908252cb0ea6e484753c/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/8a9a14a1bf771d363bb8e0af88b9dba4307ed8fa0d524c36f0a10c8c91fcb05e/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/e42cf42252bc6c5b7c77efd1f9d1c95f9be3ada7ab408711eb9de58df0f8c53b/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/8e48f7144e129cdc5ed0678332928f7af5c25c55aff4d320d3e919a7891cdc01/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/f57a3e1d03a3e2b934ee29c7ed2944309650e4cf003713f8d498bfe871128157/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/357ab49011ec8e77a3e5474dc4b44eee05c10ff742f9768600be5c300df16fd9/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-248:{mountpoint:/var/lib/containers/storage/overlay/c4a6cc5e95ef306d4d73e647b1532df384d8556ede39a46e6823160a86943e92/merged major:0 minor:248 fsType:overlay blockSize:0} overlay_0-250:{mountpoint:/var/lib/containers/storage/overlay/da92c65d00a54df4449b9c148e6e4f63844bac9cc44473892aab369255be8412/merged major:0 minor:250 fsType:overlay blockSize:0} overlay_0-252:{mountpoint:/var/lib/containers/storage/overlay/d41d15d3f38324ec76cbf42cd67dfe0632bbde39d073dac3c9674b13490e9aa0/merged major:0 minor:252 fsType:overlay blockSize:0} overlay_0-254:{mountpoint:/var/lib/containers/storage/overlay/6a2a2d9bfb1083dff9211f9d1f9966db83ac417dd5bf9e1bf4d7db66179c6120/merged major:0 minor:254 fsType:overlay blockSize:0} overlay_0-256:{mountpoint:/var/lib/containers/storage/overlay/0119634a2c698eae43ccb5743f0261e99d46c68af99b1b0a30957a38ce734e87/merged major:0 minor:256 fsType:overlay blockSize:0} overlay_0-258:{mountpoint:/var/lib/containers/storage/overlay/380332f215387e4d8466516e7767c8461fe8dfa3312a39f1ea7b9f147d88355d/merged major:0 minor:258 fsType:overlay blockSize:0} overlay_0-260:{mountpoint:/var/lib/containers/storage/overlay/4d34bf112825e71695f5e378670283c6b67c73b98d19c574b44ebcc857bcd9ca/merged major:0 minor:260 fsType:overlay blockSize:0} overlay_0-262:{mountpoint:/var/lib/containers/storage/overlay/5d8e7fd34c84819089837647dc3a41d1b5a470b88d59533b4ed3111403dbf9bd/merged major:0 minor:262 fsType:overlay blockSize:0} overlay_0-263:{mountpoint:/var/lib/containers/storage/overlay/1fe6bea4449db3422ece77e873a658d65fc029b2b9dfcf16d039ff7df9275e1d/merged major:0 minor:263 fsType:overlay blockSize:0} overlay_0-269:{mountpoint:/var/lib/containers/storage/overlay/9714c1f06ca174be204c519a3f6951193d1a28e0f2f1acef5b93e68fd699b51e/merged major:0 minor:269 fsType:overlay blockSize:0} overlay_0-271:{mountpoint:/var/lib/containers/storage/overlay/9e02542fede830311bb6837fd8663d58354b4a92d72f95fd61737939966eb41f/merged major:0 minor:271 fsType:overlay blockSize:0} overlay_0-282:{mountpoint:/var/lib/containers/storage/overlay/042016081f08cbc85aa6c782743017d63efd68c32b026406a903c2fd0f7dddd1/merged major:0 minor:282 fsType:overlay blockSize:0} overlay_0-284:{mountpoint:/var/lib/containers/storage/overlay/683c03fc9f4e53df5fb9b932b94c3939d2aec9fee7826bd2892de488621b4033/merged major:0 minor:284 fsType:overlay blockSize:0} overlay_0-286:{mountpoint:/var/lib/containers/storage/overlay/ef7ea6b0d30915b7690f2d9b86dbc2a6419f5623742bdaaa246366d9e41c2378/merged major:0 minor:286 fsType:overlay blockSize:0} overlay_0-298:{mountpoint:/var/lib/containers/storage/overlay/3752abce14e3d6550474881b5ea8ca181c4dcca822634e115050e5222b77fe1f/merged major:0 minor:298 fsType:overlay blockSize:0} overlay_0-300:{mountpoint:/var/lib/containers/storage/overlay/6a72c45b663b25227dc6338140fd605d90093811ad72e5288dffd77d8caeb959/merged major:0 minor:300 fsType:overlay blockSize:0} overlay_0-302:{mountpoint:/var/lib/containers/storage/overlay/fb3412a5ae975dca096399825171f00c58f207a0118c9a8b188b4135e017b1dd/merged major:0 minor:302 fsType:overlay blockSize:0} overlay_0-304:{mountpoint:/var/lib/containers/storage/overlay/4a49d99f7f5f9f7c434b441d24fff9b3ff77e1dde87ab93e50c83145ff724586/merged major:0 minor:304 fsType:overlay blockSize:0} overlay_0-310:{mountpoint:/var/lib/containers/storage/overlay/4893fef1e9254d0fd77a8e604ab41e6ae99b58959a930b7af6f08b5b0a45860b/merged major:0 minor:310 fsType:overlay blockSize:0} overlay_0-326:{mountpoint:/var/lib/containers/storage/overlay/f07be876f4ca3d66ad94cae181e4422551237f4ef973d154b67eba5e44963e00/merged major:0 minor:326 fsType:overlay blockSize:0} overlay_0-328:{mountpoint:/var/lib/containers/storage/overlay/928d13b4c67d365d4ac4ac99bbeda63a335735b1d91a5a66a9855c059c4272dc/merged major:0 minor:328 fsType:overlay blockSize:0} overlay_0-332:{mountpoint:/var/lib/containers/storage/overlay/d8f022d5cfcb71582aee86bf709aff01dd27735fda39fc31a93dff66e13c9e6f/merged major:0 minor:332 fsType:overlay blockSize:0} overlay_0-334:{mountpoint:/var/lib/containers/storage/overlay/198e00918054c5083646a973d60da1e18d740528e30924e729dc395e79e7bf01/merged major:0 minor:334 fsType:overlay blockSize:0} overlay_0-337:{mountpoint:/var/lib/containers/storage/overlay/953bed784326828ffc34a87fdb2967bd805c1415907838a4b545cda20331d1d0/merged major:0 minor:337 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/13a7b29fdf9522521d258bfdf75cc448b26164fbc9e908ee23f0d8cfa93511b2/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-358:{mountpoint:/var/lib/containers/storage/overlay/1fb910418f110361925e8a10a94a512b0d23be4c3d89cf4117acb44f19ed9728/merged major:0 minor:358 fsType:overlay blockSize:0} overlay_0-360:{mountpoint:/var/lib/containers/storage/overlay/367cbdb7486b0a2d900881b518748cf811420febb546a93cc60828c4ed6879db/merged major:0 minor:360 fsType:overlay blockSize:0} overlay_0-365:{mountpoint:/var/lib/containers/storage/overlay/3d8bd8a5d66004187db4d02fabbd4aa66a2917199e6016f8e212579f33f5e517/merged major:0 minor:365 fsType:overlay blockSize:0} overlay_0-368:{mountpoint:/var/lib/containers/storage/overlay/9b9fc226d7ecb9e0800557f484c1dcce124eab5f4e73cae683d7082f83c0e093/merged major:0 minor:368 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/604cc0e0b5f2f7917a9c019562643059d3c547066abacc3f63c1360d7ebea429/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-376:{mountpoint:/var/lib/containers/storage/overlay/5d2f48980ba7514015215109bbee82af5048fdfcf143689dec9f8d93a0fec28b/merged major:0 minor:376 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/ef97fba5f0d0f7e5d6c0bb70089091b396e0761abf9c8940f106eb157686f0ad/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/424b424a7cfe96a852843fdf084a5f80770ddc58922f8be5778f5b8d85e7bd22/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-71:{mountpoint:/var/lib/containers/storage/overlay/5c48f426ab3cab6da6ba1821d22825c291214d64f8455d58b1a3efa53cb093a5/merged major:0 minor:71 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/dd485220dd4e1ac695cb9e29e968e58d17d8b541659bf52400b726a2880bb724/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/dd52f11aae1a6ab035064ffc6146e32416afb966730e67fade867e460a13b294/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-80:{mountpoint:/var/lib/containers/storage/overlay/dd19ccbfd93f3b71e38d095fb95c75fd3e7f5fdc2964dc5a7252ebb71061eed1/merged major:0 minor:80 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/169abd200c07d855bf535ea7c58bb4eb5facd41c5c00da8a0e97d4c1428cc2d1/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/5cad51da19a81380a8720def9c1c566872516069f0ae7819fdcc291c63f99566/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/199909d6d4b7976c547a969519735ca6b86d3e0cf52b0461c41845fd0e175303/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/ab33546a799a9e71fb566eb59771cd6837e53be073e8b63f9607f2f7ed57d0d9/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 31 07:28:05.560754 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.560349    5039 manager.go:217] Machine: {Timestamp:2026-10-31 07:28:05.559871104 +0000 UTC m=+0.089065769 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098314 MemoryCapacity:33164341248 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec265a6e6dca8a058ac1af5b87fd955b SystemUUID:ec265a6e-6dca-8a05-8ac1-af5b87fd955b BootID:2a06822d-cb2c-4e73-96e6-87d48ca1ab8a Filesystems:[{Device:overlay_0-310 DeviceMajor:0 DeviceMinor:310 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d8753ed2-8968-47dc-aae5-6abc034f7435/volumes/kubernetes.io~projected/kube-api-access-dwvrx DeviceMajor:0 DeviceMinor:340 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/71156071-2868-4bea-8ba9-20f9e073d996/volumes/kubernetes.io~projected/kube-api-access-zjfgb DeviceMajor:0 DeviceMinor:210 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-334 DeviceMajor:0 DeviceMinor:334 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ca784faed0f673b74424fbbbd118c54ef9e1b28687a59cd61e1a94de3f15eb4e/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:205 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:217 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/25eb80fc-fccc-4c7e-8e18-21d4afc76c55/volumes/kubernetes.io~projected/kube-api-access-rd52j DeviceMajor:0 DeviceMinor:330 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f52400aca8e99b03ee91be055f11689304165f4ed69cce0796c8ad8768c73e60/userdata/shm DeviceMajor:0 DeviceMinor:229 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/78cee45ff085d114a5ed0c7d97cb295a14ddc15f810dd71334dcf9eee3fa5687/userdata/shm DeviceMajor:0 DeviceMinor:237 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-328 DeviceMajor:0 DeviceMinor:328 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/508a0686-e4c7-472a-b608-d270a7dbce3d/volumes/kubernetes.io~projected/kube-api-access-nsx85 DeviceMajor:0 DeviceMinor:66 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a6ef01d3e3777e37ed95d0089348f8ee457f4c6345bd089d16c72dbfc3f0f6a2/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/904b6555-9c6d-4489-9b17-0d96d5fe2c12/volumes/kubernetes.io~projected/kube-api-access-ggnwk DeviceMajor:0 DeviceMinor:224 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0192053c48aef8c4e7de04c639b6fda6ce44e1f931fd7bc4b5414f2125bd02b1/userdata/shm DeviceMajor:0 DeviceMinor:246 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-337 DeviceMajor:0 DeviceMinor:337 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c091275e6be81bd30a74f28e7de057b145f8e7be78d03bb64fe99292c565b4ee/userdata/shm DeviceMajor:0 DeviceMinor:69 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9a46a25a-59fe-4cd2-8566-4203c84b5175/volumes/kubernetes.io~projected/kube-api-access-8f49g DeviceMajor:0 DeviceMinor:228 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/626292732b189f0a88531cf479737061bf352473bfc57ead302dd6f7ea19e083/userdata/shm DeviceMajor:0 DeviceMinor:231 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/6c81d44f5390e022b44db75eca8b84f82eebec773b2479f861ff781cda6818e4/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-302 DeviceMajor:0 DeviceMinor:302 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/03abbf752528aad256d10130a09b5a61f64d5aee71acc0f5363694e9dfe89d36/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:58 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/078fdc95-76b1-4323-9985-905f939dbbc4/volumes/kubernetes.io~projected/kube-api-access-lvs8d DeviceMajor:0 DeviceMinor:227 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-260 DeviceMajor:0 DeviceMinor:260 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ad965044-2fab-47cf-935d-47121860352c/volumes/kubernetes.io~projected/kube-api-access-h9kb7 DeviceMajor:0 DeviceMinor:331 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/06e7dac1-d91c-4928-bbca-a4d1535e2170/volumes/kubernetes.io~projected/kube-api-access-lrmzs DeviceMajor:0 DeviceMinor:61 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~projected/kube-api-access-t96md DeviceMajor:0 DeviceMinor:208 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/6b351b59-c90b-42cb-87b1-228f83da0488/volumes/kubernetes.io~projected/kube-api-access-hk4xv DeviceMajor:0 DeviceMinor:211 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e3bb7d9d6ee1f636bc108e8694142b265f73a06a535518460a0f3368271bf954/userdata/shm DeviceMajor:0 DeviceMinor:242 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-263 DeviceMajor:0 DeviceMinor:263 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/537c42ce1bf48532262d5c2d266a88d8b3caefa21ae68011c71bbdff8b8e146b/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-271 DeviceMajor:0 DeviceMinor:271 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-300 DeviceMajor:0 DeviceMinor:300 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-326 DeviceMajor:0 DeviceMinor:326 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d8753ed2-8968-47dc-aae5-6abc034f7435/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:336 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-365 DeviceMajor:0 DeviceMinor:365 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-71 DeviceMajor:0 DeviceMinor:71 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582168576 Type:vfs Inodes:4048381 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582172672 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/408136c3-732d-4564-a1f8-c969888f361d/volumes/kubernetes.io~projected/kube-api-access-24qkk DeviceMajor:0 DeviceMinor:60 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/300dbf94145c0562b44cc2e4dacd91cd5d4e6537f17608eaa5fadcf843a3ed79/userdata/shm DeviceMajor:0 DeviceMinor:89 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb/volumes/kubernetes.io~projected/kube-api-access-46h8f DeviceMajor:0 DeviceMinor:201 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/volumes/kubernetes.io~projected/kube-api-access-7775h DeviceMajor:0 DeviceMinor:63 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-136 DeviceMajor:0 DeviceMinor:136 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2c29d7fa71c62cdece9daae0eda413e926bdaa81da35325cc86d337d0800a7fd/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ccea0fe7-8780-408e-b799-299e44328b4f/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:216 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:223 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:218 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8a16c8bad71aa477555a9bec2f2efd79bf271f4e7d0d06d7ce161bb37aecdb31/userdata/shm DeviceMajor:0 DeviceMinor:322 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-360 DeviceMajor:0 DeviceMinor:360 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/f2d1eb29-7f18-41ee-949d-33892c4b30c1/volumes/kubernetes.io~projected/kube-api-access-vrth6 DeviceMajor:0 DeviceMinor:59 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-144 DeviceMajor:0 DeviceMinor:144 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6330753d-1f92-46d9-a1ff-70262d02c414/volumes/kubernetes.io~projected/kube-api-access-px9bt DeviceMajor:0 DeviceMinor:312 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/a2320145-3aab-44be-a1c2-7912c2498c30/volumes/kubernetes.io~projected/kube-api-access-sbnpr DeviceMajor:0 DeviceMinor:65 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/71156071-2868-4bea-8ba9-20f9e073d996/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:203 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-254 DeviceMajor:0 DeviceMinor:254 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/21fea0a5-efb9-4b1a-b561-d173b3ad6169/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:288 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4820d461-a6e0-49fe-a57c-dbff7bc255f8/volumes/kubernetes.io~projected/kube-api-access-mrxr9 DeviceMajor:0 DeviceMinor:62 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4167bdf8-9b23-482d-805f-c6fdeeda5384/volumes/kubernetes.io~projected/kube-api-access-k4kdq DeviceMajor:0 DeviceMinor:207 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9f3e973fbb857b823585edb8f7e3ebf0ddb14a380d9b0ec9aaca95bd3276082d/userdata/shm DeviceMajor:0 DeviceMinor:233 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/e248978c-acdb-47f0-b702-c0029711230d/volumes/kubernetes.io~projected/kube-api-access-4z2c6 DeviceMajor:0 DeviceMinor:241 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-258 DeviceMajor:0 DeviceMinor:258 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f590b572ae403562acb55a707e1a8580bd38d13a42ca3387f5238b7046b6498f/userdata/shm DeviceMajor:0 DeviceMinor:339 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/29654c5b-afac-4935-b729-3e5b5c8adf50/volumes/kubernetes.io~projected/kube-api-access-g4vtt DeviceMajor:0 DeviceMinor:64 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6b351b59-c90b-42cb-87b1-228f83da0488/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:204 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/904b6555-9c6d-4489-9b17-0d96d5fe2c12/volumes/kubernetes.io~secret/serving-cert DeviceMajor:0 DeviceMinor:219 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~projected/kube-api-access-t2v55 DeviceMajor:0 DeviceMinor:226 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-256 DeviceMajor:0 DeviceMinor:256 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/08b9f307ff09d585a8d221810ce84a6fb2c2fe8b386d59ff55086576e5db9ae2/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-80 DeviceMajor:0 DeviceMinor:80 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/93fbf2f3d9d06aeef147be5d9729517950f9ef4d107aa8023aaa58497e470f98/userdata/shm DeviceMajor:0 DeviceMinor:82 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/5a3e7931-f6a9-419d-8cce-5c884e627036/volumes/kubernetes.io~projected/kube-api-access-gk4bt DeviceMajor:0 DeviceMinor:222 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ddb7f8f4c8b171aaff7ea88759f6199e086e6567ff926dbd4d4eb906f8451386/userdata/shm DeviceMajor:0 DeviceMinor:235 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-282 DeviceMajor:0 DeviceMinor:282 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-252 DeviceMajor:0 DeviceMinor:252 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec/volumes/kubernetes.io~projected/kube-api-access-nk28k DeviceMajor:0 DeviceMinor:225 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-250 DeviceMajor:0 DeviceMinor:250 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-284 DeviceMajor:0 DeviceMinor:284 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-332 DeviceMajor:0 DeviceMinor:332 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes/kubernetes.io~secret/installation-pull-secrets DeviceMajor:0 DeviceMinor:220 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-358 DeviceMajor:0 DeviceMinor:358 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/29654c5b-afac-4935-b729-3e5b5c8adf50/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/735f0bbc-22c2-4f33-af0d-6fc10cda9e17/volumes/kubernetes.io~projected/kube-api-access-58wkr DeviceMajor:0 DeviceMinor:212 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ec622f400d3a5ffc6f5a88d6919723990928b601e9028d3ea20ea036dfece44e/userdata/shm DeviceMajor:0 DeviceMinor:324 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-368 DeviceMajor:0 DeviceMinor:368 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-298 DeviceMajor:0 DeviceMinor:298 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-304 DeviceMajor:0 DeviceMinor:304 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/647db033-e901-4100-b8a0-a60948730917/volumes/kubernetes.io~projected/kube-api-access-dq2z7 DeviceMajor:0 DeviceMinor:295 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-161 DeviceMajor:0 DeviceMinor:161 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/volumes/kubernetes.io~secret/stats-auth DeviceMajor:0 DeviceMinor:45 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c8c0dc0861d65b0145f2bd4ff977609829a728df3f1c28f7468aec8d6abb228e/userdata/shm DeviceMajor:0 DeviceMinor:243 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7c35edefa2c76448c64ca8bc46ca6c176e28c0fd43830dce6d7d567666e59657/userdata/shm DeviceMajor:0 DeviceMinor:293 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b9d6d79758591128284893b48d027583ff81a05dd4af58a8120f9e196dcbc98a/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-269 DeviceMajor:0 DeviceMinor:269 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/513eea23-470d-4236-ae17-1666a54ce63f/volumes/kubernetes.io~projected/kube-api-access-vg8q5 DeviceMajor:0 DeviceMinor:67 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ccea0fe7-8780-408e-b799-299e44328b4f/volumes/kubernetes.io~projected/kube-api-access-79qlm DeviceMajor:0 DeviceMinor:221 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-262 DeviceMajor:0 DeviceMinor:262 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-376 DeviceMajor:0 DeviceMinor:376 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/29654c5b-afac-4935-b729-3e5b5c8adf50/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:55 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~secret/image-registry-private-configuration DeviceMajor:0 DeviceMinor:206 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/680bd2c4-08ae-4e24-a6c0-37339d826971/volumes/kubernetes.io~projected/kube-api-access-bhb2p DeviceMajor:0 DeviceMinor:213 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5ba03c82d5eb1ef3661ef3613864e3109711ef9277c8abd3909af1fb22ab659d/userdata/shm DeviceMajor:0 DeviceMinor:342 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-248 DeviceMajor:0 DeviceMinor:248 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d48935d7e4d6b565b145e60988db297a1639ea3ef86ec35e0f2135190f35dffa/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/90d1896322dcee73dc3b1735a7e273d95193ec4cad4c28746be58079f00a4be8/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/aec5e525-a7f4-460d-aceb-f8412e0c3b2b/volumes/kubernetes.io~projected/kube-api-access-stqt2 DeviceMajor:0 DeviceMinor:317 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/volumes/kubernetes.io~secret/default-certificate DeviceMajor:0 DeviceMinor:197 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/volumes/kubernetes.io~projected/kube-api-access-prvpd DeviceMajor:0 DeviceMinor:202 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:/var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes/kubernetes.io~projected/bound-sa-token DeviceMajor:0 DeviceMinor:209 Capacity:31985741824 Type:vfs Inodes:4048381 HasInodes:true} {Device:overlay_0-286 DeviceMajor:0 DeviceMinor:286 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:0192053c48aef8c MacAddress:b6:6a:55:4b:7d:cb Speed:10000 Mtu:8901} {Name:2c29d7fa71c62cd MacAddress:1e:2c:09:96:2b:91 Speed:10000 Mtu:8901} {Name:5ba03c82d5eb1ef MacAddress:be:1a:d1:e5:9b:9e Speed:10000 Mtu:8901} {Name:626292732b189f0 MacAddress:ce:c8:7c:cc:fd:c1 Speed:10000 Mtu:8901} {Name:6c81d44f5390e02 MacAddress:ce:81:a9:2d:05:4b Speed:10000 Mtu:8901} {Name:78cee45ff085d11 MacAddress:4e:de:cf:9d:c8:b1 Speed:10000 Mtu:8901} {Name:7c35edefa2c7644 MacAddress:ca:ea:45:69:1b:69 Speed:10000 Mtu:8901} {Name:8a16c8bad71aa47 MacAddress:36:34:c2:07:71:53 Speed:10000 Mtu:8901} {Name:90d1896322dcee7 MacAddress:1e:59:59:1b:95:ea Speed:10000 Mtu:8901} {Name:9f3e973fbb857b8 MacAddress:aa:50:38:31:af:98 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d1:84:c7:99 Speed:0 Mtu:9001} {Name:br-int MacAddress:66:82:7f:58:9f:d9 Speed:0 Mtu:8901} {Name:c8c0dc0861d65b0 MacAddress:c2:e4:8c:a1:d8:9d Speed:10000 Mtu:8901} {Name:ddb7f8f4c8b171a MacAddress:7e:c0:b7:0d:0f:1f Speed:10000 Mtu:8901} {Name:e3bb7d9d6ee1f63 MacAddress:12:2f:5a:6f:43:65 Speed:10000 Mtu:8901} {Name:ec622f400d3a5ff MacAddress:16:e4:eb:79:48:76 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d1:84:c7:99 Speed:0 Mtu:9001} {Name:f52400aca8e99b0 MacAddress:2e:e3:df:80:d5:81 Speed:10000 Mtu:8901} {Name:f590b572ae40356 MacAddress:5a:3c:14:a1:c6:b8 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:6e:d0:b5:83:e2:5a Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:84:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:8a:79:1a:8c:87:92 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164341248 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 07:28:05.561040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.560758    5039 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 07:28:05.561040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.560808    5039 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 07:28:05.561154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561129    5039 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 07:28:05.561290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561155    5039 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-20.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 07:28:05.561339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561293    5039 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 07:28:05.561339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561301    5039 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 07:28:05.561339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561316    5039 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 07:28:05.561339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561331    5039 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 07:28:05.561451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561357    5039 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 07:28:05.561533 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561523    5039 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 07:28:05.561634 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561625    5039 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 07:28:05.561671 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561662    5039 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 07:28:05.561700 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561672    5039 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 07:28:05.561700 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561682    5039 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 07:28:05.561700 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561691    5039 kubelet.go:405] "Adding apiserver pod source"
Oct 31 07:28:05.561700 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.561699    5039 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 07:28:05.562384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.562367    5039 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 07:28:05.562384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.562380    5039 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 07:28:05.562897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.562875    5039 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 07:28:05.565213 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565196    5039 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 07:28:05.565213 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565209    5039 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 07:28:05.565333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565307    5039 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 31 07:28:05.565498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565487    5039 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 07:28:05.565531 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565515    5039 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 07:28:05.565626 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565616    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 07:28:05.565657 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565631    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 07:28:05.565657 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565638    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 07:28:05.565657 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565644    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 07:28:05.565657 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565655    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 07:28:05.565758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565664    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 07:28:05.565758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565671    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 07:28:05.565758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565677    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 07:28:05.565758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565683    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 07:28:05.565758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565690    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 07:28:05.565758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565705    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 07:28:05.565758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565716    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 07:28:05.565758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565750    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 07:28:05.565758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.565759    5039 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 07:28:05.569264 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.569252    5039 server.go:1263] "Started kubelet"
Oct 31 07:28:05.569359 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.569331    5039 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 07:28:05.569406 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.569351    5039 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 07:28:05.569452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.569422    5039 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 07:28:05.569763 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.569743    5039 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 07:28:05.569798 ip-10-0-128-20 systemd[1]: Started Kubernetes Kubelet.
Oct 31 07:28:05.570729 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.570643    5039 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 07:28:05.576399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.576228    5039 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 07:28:05.576399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.576245    5039 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 07:28:05.576399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.576329    5039 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 07:22:26 +0000 UTC" deadline="2028-03-30 02:15:58.349590903 +0000 UTC"
Oct 31 07:28:05.576399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.576362    5039 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12378h47m52.77323202s"
Oct 31 07:28:05.576639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.576404    5039 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 07:28:05.576639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.576421    5039 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 07:28:05.576639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.576482    5039 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 07:28:05.576817 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:05.576683    5039 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-128-20.ec2.internal\" not found"
Oct 31 07:28:05.579119 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579049    5039 factory.go:55] Registering systemd factory
Oct 31 07:28:05.579119 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579074    5039 factory.go:223] Registration of the systemd container factory successfully
Oct 31 07:28:05.579365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579268    5039 factory.go:153] Registering CRI-O factory
Oct 31 07:28:05.579365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579280    5039 factory.go:223] Registration of the crio container factory successfully
Oct 31 07:28:05.579365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579302    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" volumeName="kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token" seLinuxMountContext=""
Oct 31 07:28:05.579365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579335    5039 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 07:28:05.579365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579336    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" volumeName="kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets" seLinuxMountContext=""
Oct 31 07:28:05.579365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579353    5039 factory.go:103] Registering Raw factory
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579371    5039 manager.go:1199] Started watching for new ooms in manager
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579350    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8753ed2-8968-47dc-aae5-6abc034f7435" volumeName="kubernetes.io/configmap/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-cabundle" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579421    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8753ed2-8968-47dc-aae5-6abc034f7435" volumeName="kubernetes.io/secret/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-key" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579441    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="21fea0a5-efb9-4b1a-b561-d173b3ad6169" volumeName="kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579456    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265" volumeName="kubernetes.io/projected/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-kube-api-access-7775h" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579469    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="508a0686-e4c7-472a-b608-d270a7dbce3d" volumeName="kubernetes.io/projected/508a0686-e4c7-472a-b608-d270a7dbce3d-kube-api-access-nsx85" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579483    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a3e7931-f6a9-419d-8cce-5c884e627036" volumeName="kubernetes.io/projected/5a3e7931-f6a9-419d-8cce-5c884e627036-kube-api-access-gk4bt" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579500    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b351b59-c90b-42cb-87b1-228f83da0488" volumeName="kubernetes.io/configmap/6b351b59-c90b-42cb-87b1-228f83da0488-config" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579515    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71156071-2868-4bea-8ba9-20f9e073d996" volumeName="kubernetes.io/projected/71156071-2868-4bea-8ba9-20f9e073d996-kube-api-access-zjfgb" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579529    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad965044-2fab-47cf-935d-47121860352c" volumeName="kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579545    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccea0fe7-8780-408e-b799-299e44328b4f" volumeName="kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-trusted-ca" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579561    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="29654c5b-afac-4935-b729-3e5b5c8adf50" volumeName="kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-tuned" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579590    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" volumeName="kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579606    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d8753ed2-8968-47dc-aae5-6abc034f7435" volumeName="kubernetes.io/projected/d8753ed2-8968-47dc-aae5-6abc034f7435-kube-api-access-dwvrx" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579620    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2d1eb29-7f18-41ee-949d-33892c4b30c1" volumeName="kubernetes.io/configmap/f2d1eb29-7f18-41ee-949d-33892c4b30c1-serviceca" seLinuxMountContext=""
Oct 31 07:28:05.579650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579634    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="508a0686-e4c7-472a-b608-d270a7dbce3d" volumeName="kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 31 07:28:05.580452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579663    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="680bd2c4-08ae-4e24-a6c0-37339d826971" volumeName="kubernetes.io/projected/680bd2c4-08ae-4e24-a6c0-37339d826971-kube-api-access-bhb2p" seLinuxMountContext=""
Oct 31 07:28:05.580452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579677    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904b6555-9c6d-4489-9b17-0d96d5fe2c12" volumeName="kubernetes.io/secret/904b6555-9c6d-4489-9b17-0d96d5fe2c12-serving-cert" seLinuxMountContext=""
Oct 31 07:28:05.580452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579690    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" volumeName="kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates" seLinuxMountContext=""
Oct 31 07:28:05.580452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579702    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" volumeName="kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token" seLinuxMountContext=""
Oct 31 07:28:05.580452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579717    5039 manager.go:319] Starting recovery of all containers
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.579715    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4820d461-a6e0-49fe-a57c-dbff7bc255f8" volumeName="kubernetes.io/configmap/4820d461-a6e0-49fe-a57c-dbff7bc255f8-iptables-alerter-script" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582511    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4820d461-a6e0-49fe-a57c-dbff7bc255f8" volumeName="kubernetes.io/projected/4820d461-a6e0-49fe-a57c-dbff7bc255f8-kube-api-access-mrxr9" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582547    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="647db033-e901-4100-b8a0-a60948730917" volumeName="kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582560    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" volumeName="kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582572    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" volumeName="kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582584    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" volumeName="kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582597    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccea0fe7-8780-408e-b799-299e44328b4f" volumeName="kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-config" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582618    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="408136c3-732d-4564-a1f8-c969888f361d" volumeName="kubernetes.io/projected/408136c3-732d-4564-a1f8-c969888f361d-kube-api-access-24qkk" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582630    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a2320145-3aab-44be-a1c2-7912c2498c30" volumeName="kubernetes.io/projected/a2320145-3aab-44be-a1c2-7912c2498c30-kube-api-access-sbnpr" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582644    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e248978c-acdb-47f0-b702-c0029711230d" volumeName="kubernetes.io/empty-dir/e248978c-acdb-47f0-b702-c0029711230d-tmp-dir" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582656    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2a867c49-34bc-4114-8ee9-c3f30900d501" volumeName="kubernetes.io/configmap/2a867c49-34bc-4114-8ee9-c3f30900d501-nginx-conf" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582668    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4118a0cf-82b9-4bf6-a953-3af32ca0b5f4" volumeName="kubernetes.io/projected/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-kube-api-access-prvpd" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582680    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5a3e7931-f6a9-419d-8cce-5c884e627036" volumeName="kubernetes.io/configmap/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-config" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582694    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904b6555-9c6d-4489-9b17-0d96d5fe2c12" volumeName="kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-tmp" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582706    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9a46a25a-59fe-4cd2-8566-4203c84b5175" volumeName="kubernetes.io/projected/9a46a25a-59fe-4cd2-8566-4203c84b5175-kube-api-access-8f49g" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582718    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" volumeName="kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582730    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="513eea23-470d-4236-ae17-1666a54ce63f" volumeName="kubernetes.io/projected/513eea23-470d-4236-ae17-1666a54ce63f-kube-api-access-vg8q5" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582743    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904b6555-9c6d-4489-9b17-0d96d5fe2c12" volumeName="kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-snapshots" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582755    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb" volumeName="kubernetes.io/projected/a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb-kube-api-access-46h8f" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582768    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" volumeName="kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582779    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad965044-2fab-47cf-935d-47121860352c" volumeName="kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582794    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9d4b049-ebbe-4c4f-b792-d74110bc6ec0" volumeName="kubernetes.io/secret/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-agent-certs" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582806    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06e7dac1-d91c-4928-bbca-a4d1535e2170" volumeName="kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-cni-binary-copy" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582819    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="078fdc95-76b1-4323-9985-905f939dbbc4" volumeName="kubernetes.io/configmap/078fdc95-76b1-4323-9985-905f939dbbc4-telemetry-config" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582832    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="508a0686-e4c7-472a-b608-d270a7dbce3d" volumeName="kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-binary-copy" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582847    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265" volumeName="kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-config" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582859    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d6e9a9a-37e4-4f68-975d-fada2cfc80ec" volumeName="kubernetes.io/projected/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-kube-api-access-nk28k" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582872    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71156071-2868-4bea-8ba9-20f9e073d996" volumeName="kubernetes.io/secret/71156071-2868-4bea-8ba9-20f9e073d996-serving-cert" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582886    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="29654c5b-afac-4935-b729-3e5b5c8adf50" volumeName="kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-tmp" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582898    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265" volumeName="kubernetes.io/secret/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582910    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4118a0cf-82b9-4bf6-a953-3af32ca0b5f4" volumeName="kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-default-certificate" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582939    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25eb80fc-fccc-4c7e-8e18-21d4afc76c55" volumeName="kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 31 07:28:05.582961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582952    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25eb80fc-fccc-4c7e-8e18-21d4afc76c55" volumeName="kubernetes.io/projected/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-api-access-rd52j" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.582997    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4167bdf8-9b23-482d-805f-c6fdeeda5384" volumeName="kubernetes.io/projected/4167bdf8-9b23-482d-805f-c6fdeeda5384-kube-api-access-k4kdq" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583016    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" volumeName="kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583051    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" volumeName="kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583064    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" volumeName="kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583078    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aec5e525-a7f4-460d-aceb-f8412e0c3b2b" volumeName="kubernetes.io/projected/aec5e525-a7f4-460d-aceb-f8412e0c3b2b-kube-api-access-stqt2" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583090    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccea0fe7-8780-408e-b799-299e44328b4f" volumeName="kubernetes.io/projected/ccea0fe7-8780-408e-b799-299e44328b4f-kube-api-access-79qlm" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583101    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="29654c5b-afac-4935-b729-3e5b5c8adf50" volumeName="kubernetes.io/projected/29654c5b-afac-4935-b729-3e5b5c8adf50-kube-api-access-g4vtt" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583114    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="71156071-2868-4bea-8ba9-20f9e073d996" volumeName="kubernetes.io/configmap/71156071-2868-4bea-8ba9-20f9e073d996-config" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583126    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="735f0bbc-22c2-4f33-af0d-6fc10cda9e17" volumeName="kubernetes.io/projected/735f0bbc-22c2-4f33-af0d-6fc10cda9e17-kube-api-access-58wkr" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583137    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904b6555-9c6d-4489-9b17-0d96d5fe2c12" volumeName="kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583151    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e248978c-acdb-47f0-b702-c0029711230d" volumeName="kubernetes.io/configmap/e248978c-acdb-47f0-b702-c0029711230d-config-volume" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583163    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="f2d1eb29-7f18-41ee-949d-33892c4b30c1" volumeName="kubernetes.io/projected/f2d1eb29-7f18-41ee-949d-33892c4b30c1-kube-api-access-vrth6" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583175    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="078fdc95-76b1-4323-9985-905f939dbbc4" volumeName="kubernetes.io/projected/078fdc95-76b1-4323-9985-905f939dbbc4-kube-api-access-lvs8d" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583187    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265" volumeName="kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-script-lib" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583200    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="508a0686-e4c7-472a-b608-d270a7dbce3d" volumeName="kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583212    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b351b59-c90b-42cb-87b1-228f83da0488" volumeName="kubernetes.io/projected/6b351b59-c90b-42cb-87b1-228f83da0488-kube-api-access-hk4xv" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583225    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" volumeName="kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583240    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad965044-2fab-47cf-935d-47121860352c" volumeName="kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583251    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ad965044-2fab-47cf-935d-47121860352c" volumeName="kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583262    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ccea0fe7-8780-408e-b799-299e44328b4f" volumeName="kubernetes.io/secret/ccea0fe7-8780-408e-b799-299e44328b4f-serving-cert" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583274    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="25eb80fc-fccc-4c7e-8e18-21d4afc76c55" volumeName="kubernetes.io/empty-dir/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-data-volume" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583288    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e248978c-acdb-47f0-b702-c0029711230d" volumeName="kubernetes.io/projected/e248978c-acdb-47f0-b702-c0029711230d-kube-api-access-4z2c6" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583301    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e9d4b049-ebbe-4c4f-b792-d74110bc6ec0" volumeName="kubernetes.io/configmap/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-konnectivity-ca" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583312    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06e7dac1-d91c-4928-bbca-a4d1535e2170" volumeName="kubernetes.io/projected/06e7dac1-d91c-4928-bbca-a4d1535e2170-kube-api-access-lrmzs" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583326    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265" volumeName="kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-env-overrides" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583339    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="408136c3-732d-4564-a1f8-c969888f361d" volumeName="kubernetes.io/empty-dir/408136c3-732d-4564-a1f8-c969888f361d-tmp-dir" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583352    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4118a0cf-82b9-4bf6-a953-3af32ca0b5f4" volumeName="kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-stats-auth" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583364    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="5d6e9a9a-37e4-4f68-975d-fada2cfc80ec" volumeName="kubernetes.io/secret/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-cert" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583377    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6330753d-1f92-46d9-a1ff-70262d02c414" volumeName="kubernetes.io/projected/6330753d-1f92-46d9-a1ff-70262d02c414-kube-api-access-px9bt" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583389    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6b351b59-c90b-42cb-87b1-228f83da0488" volumeName="kubernetes.io/secret/6b351b59-c90b-42cb-87b1-228f83da0488-serving-cert" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583402    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904b6555-9c6d-4489-9b17-0d96d5fe2c12" volumeName="kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-service-ca-bundle" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583416    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="06e7dac1-d91c-4928-bbca-a4d1535e2170" volumeName="kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-daemon-config" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583428    5039 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="904b6555-9c6d-4489-9b17-0d96d5fe2c12" volumeName="kubernetes.io/projected/904b6555-9c6d-4489-9b17-0d96d5fe2c12-kube-api-access-ggnwk" seLinuxMountContext=""
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583445    5039 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 07:28:05.584571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.583454    5039 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 07:28:05.596710 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.596680    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:28:05.596903 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.596871    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:28:05.606160 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.606127    5039 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 07:28:05.607651 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.607631    5039 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 07:28:05.607651 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.607651    5039 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 07:28:05.607809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.607671    5039 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 07:28:05.607809 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:05.607710    5039 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 31 07:28:05.620466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.620443    5039 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 31 07:28:05.621040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.621015    5039 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:28:05.622989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.621790    5039 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:28:05.632590 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.632534    5039 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="18598ec35b4d843b4e514ae67b005370e7678f57d42af638cc1d3ab1c34c2390" exitCode=0
Oct 31 07:28:05.632590 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.632569    5039 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="4a2b218c73833141e5f6013230bae12f8dfa6a36502353333c19b8e5e8a45e5f" exitCode=0
Oct 31 07:28:05.632590 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.632580    5039 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="a03b220fded845581679460899e03ed778ee67051502f84abf0d01b350265621" exitCode=0
Oct 31 07:28:05.632843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.632601    5039 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="2250b3b46ddbebccf6e24ebc36fa25546025f14bc7cfc6b3319e2a5fd325c3ad" exitCode=0
Oct 31 07:28:05.632843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.632610    5039 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="1d3c49888a252ebc8c0cb556228b96424251244b198a134089dcf6e295cb5f22" exitCode=0
Oct 31 07:28:05.632843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.632618    5039 generic.go:356] "Generic (PLEG): container finished" podID="508a0686-e4c7-472a-b608-d270a7dbce3d" containerID="4184bac5cac55150fc76337d87e451bb8faf5c1e67cb8ea0aa58481d655144c8" exitCode=0
Oct 31 07:28:05.635464 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.634270    5039 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:28:05.635464 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.634476    5039 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 07:28:05.644514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.644482    5039 generic.go:356] "Generic (PLEG): container finished" podID="8023f9bb6bcb2bf36bd9213cfe9f546d" containerID="233ae652b526dcb6e257dc15519b69b938fb2e9acaeb56b4d78afb0f50dc56eb" exitCode=0
Oct 31 07:28:05.648888 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.648862    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:28:05.649071 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.649046    5039 generic.go:356] "Generic (PLEG): container finished" podID="ccea0fe7-8780-408e-b799-299e44328b4f" containerID="8aa4269ad04c105f09c29b6f6eed542dfd65d6118a3d56cb4e80acb23f0984e6" exitCode=255
Oct 31 07:28:05.685580 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.685508    5039 manager.go:324] Recovery completed
Oct 31 07:28:05.707394 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707369    5039 cpu_manager.go:226] "Starting" policy="none"
Oct 31 07:28:05.707394 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707387    5039 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 07:28:05.707568 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707410    5039 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 07:28:05.707624 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707558    5039 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 31 07:28:05.707624 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707586    5039 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 31 07:28:05.707624 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707611    5039 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 31 07:28:05.707624 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707620    5039 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 31 07:28:05.707753 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707627    5039 policy_none.go:50] "Start"
Oct 31 07:28:05.707753 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707642    5039 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 07:28:05.707753 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707654    5039 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 07:28:05.707843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707825    5039 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 31 07:28:05.707843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707834    5039 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 31 07:28:05.707843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.707842    5039 policy_none.go:44] "Start"
Oct 31 07:28:05.708071 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:05.708031    5039 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 31 07:28:05.715769 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.715724    5039 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 07:28:05.720175 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.720153    5039 manager.go:341] "Starting Device Plugin manager"
Oct 31 07:28:05.720729 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:05.720708    5039 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 07:28:05.720729 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.720728    5039 server.go:87] "Starting device plugin registration server"
Oct 31 07:28:05.721021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.721004    5039 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 07:28:05.721131 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.721021    5039 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 07:28:05.721131 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.721104    5039 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 07:28:05.721242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.721200    5039 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 07:28:05.721242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.721238    5039 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 07:28:05.721335 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.721245    5039 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 07:28:05.721377 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.721295    5039 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T07:28:05.721227161Z","UUID":"f71491ef-65f6-407d-be29-1e0434260afd","Handler":null,"Name":"","Endpoint":""}
Oct 31 07:28:05.722656 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.722637    5039 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 07:28:05.722749 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.722674    5039 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 07:28:05.723152 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:05.723127    5039 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 07:28:05.821369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.821335    5039 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 07:28:05.823604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.823580    5039 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientMemory"
Oct 31 07:28:05.823702 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.823620    5039 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasNoDiskPressure"
Oct 31 07:28:05.823702 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.823633    5039 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-128-20.ec2.internal" event="NodeHasSufficientPID"
Oct 31 07:28:05.823702 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.823675    5039 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-128-20.ec2.internal"
Oct 31 07:28:05.855908 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.855877    5039 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-128-20.ec2.internal"
Oct 31 07:28:05.856044 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.855971    5039 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-128-20.ec2.internal"
Oct 31 07:28:05.908299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.908246    5039 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"]
Oct 31 07:28:05.908979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.908937    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal" event={"ID":"8023f9bb6bcb2bf36bd9213cfe9f546d","Type":"ContainerStarted","Data":"a8b487ed062e8ccd2fb9dafe248d151cae8bb1ffb727cf7bdae56272ae343fd4"}
Oct 31 07:28:05.909031 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.908997    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal" event={"ID":"8023f9bb6bcb2bf36bd9213cfe9f546d","Type":"ContainerDied","Data":"233ae652b526dcb6e257dc15519b69b938fb2e9acaeb56b4d78afb0f50dc56eb"}
Oct 31 07:28:05.909031 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.909024    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal" event={"ID":"8023f9bb6bcb2bf36bd9213cfe9f546d","Type":"ContainerStarted","Data":"d48935d7e4d6b565b145e60988db297a1639ea3ef86ec35e0f2135190f35dffa"}
Oct 31 07:28:05.909093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.909047    5039 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:05.909093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.909064    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal" event={"ID":"e7ef466d4952ee7684f323b6e3eda034","Type":"ContainerStarted","Data":"19fc526614fef2714db480ee0f6b00e381f0219dfa050343671bc21d55d61fb2"}
Oct 31 07:28:05.909093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.909083    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal" event={"ID":"e7ef466d4952ee7684f323b6e3eda034","Type":"ContainerStarted","Data":"b9d6d79758591128284893b48d027583ff81a05dd4af58a8120f9e196dcbc98a"}
Oct 31 07:28:05.909191 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.909118    5039 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:05.932534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.932503    5039 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:28:05.932677 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:05.932558    5039 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-20.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:05.932827 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:05.932817    5039 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:28:05.932860 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:05.932839    5039 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.022860 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.022822    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.022860 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.022856    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.023084 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.022875    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7ef466d4952ee7684f323b6e3eda034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-20.ec2.internal\" (UID: \"e7ef466d4952ee7684f323b6e3eda034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.123579 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.123540    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.123579 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.123577    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.123780 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.123598    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7ef466d4952ee7684f323b6e3eda034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-20.ec2.internal\" (UID: \"e7ef466d4952ee7684f323b6e3eda034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.123780 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.123647    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e7ef466d4952ee7684f323b6e3eda034-config\") pod \"kube-apiserver-proxy-ip-10-0-128-20.ec2.internal\" (UID: \"e7ef466d4952ee7684f323b6e3eda034\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.123780 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.123649    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.123780 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.123656    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8023f9bb6bcb2bf36bd9213cfe9f546d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" (UID: \"8023f9bb6bcb2bf36bd9213cfe9f546d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.562156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.562123    5039 apiserver.go:52] "Watching apiserver"
Oct 31 07:28:06.613332 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.613299    5039 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 07:28:06.614073 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.614043    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-84prv","openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9","openshift-cluster-node-tuning-operator/tuned-xmjdj","kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms","openshift-network-operator/iptables-alerter-jm95s","openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg","openshift-service-ca/service-ca-5fffc97bdf-6ggm8","openshift-dns/dns-default-b4zz8","openshift-multus/network-metrics-daemon-fkcpf","kube-system/konnectivity-agent-kwmnp","openshift-insights/periodic-gathering-t6jrq-6cxmm","openshift-console-operator/console-operator-7cd56b8dbc-bqnjc","openshift-ovn-kubernetes/ovnkube-node-kqq5l","openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9","kube-system/global-pull-secret-syncer-qpskk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal","openshift-multus/multus-additional-cni-plugins-6ktj5","openshift-insights/insights-operator-7c4986d449-6krlj","openshift-insights/insights-runtime-extractor-98qs2","openshift-dns/node-resolver-hzt8h","kube-system/kas-connection-checker-685895c7c9-r4hl6","openshift-image-registry/image-registry-59b48874d4-s59mc","openshift-multus/multus-j9f7v","openshift-image-registry/image-registry-5cb764d49-7pjn2","openshift-image-registry/node-ca-8498p","openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp","openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg","openshift-network-diagnostics/network-check-target-mtrsf","openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc","openshift-ingress-canary/ingress-canary-rw59c","openshift-ingress/router-default-79b9f58c8f-wd2zk","kube-system/kas-connection-checker-685895c7c9-2qw6l","openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq","openshift-network-console/networking-console-plugin-86c478bb88-pplb8","kube-system/kas-connection-checker-685895c7c9-zl6kk"]
Oct 31 07:28:06.616662 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.616637    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:06.617123 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.617108    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:06.620476 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.620453    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.621285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.621265    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.621609 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.621592    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:06.626321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.626302    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:28:06.627428 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.627412    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.628794 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.628778    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:06.629328 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.629308    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.629445 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.629314    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.629445 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.629424    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Oct 31 07:28:06.629445 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.629346    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Oct 31 07:28:06.629594 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.629365    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nzgms\""
Oct 31 07:28:06.629594 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.629388    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.629594 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.629331    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.629594 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.629463    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Oct 31 07:28:06.630942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.630905    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.639567 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.639544    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Oct 31 07:28:06.639660 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.639643    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-24gf5\""
Oct 31 07:28:06.640053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640036    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-frnnq\""
Oct 31 07:28:06.640202 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640186    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.640278 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640219    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Oct 31 07:28:06.640393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640372    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Oct 31 07:28:06.640445 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640395    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 07:28:06.640445 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640384    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7kbgw\""
Oct 31 07:28:06.640514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640434    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 07:28:06.640514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640506    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fh9bq\""
Oct 31 07:28:06.640643 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640619    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-dockercfg-4qv68\""
Oct 31 07:28:06.640811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640795    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rrtkw\""
Oct 31 07:28:06.640905 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640888    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 07:28:06.640977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640943    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Oct 31 07:28:06.641045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640991    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dvv9v\""
Oct 31 07:28:06.641045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640995    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.641045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.640997    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Oct 31 07:28:06.641045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641032    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Oct 31 07:28:06.641233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641126    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-xhs6v\""
Oct 31 07:28:06.641233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641151    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.641233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641205    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n7m4f\""
Oct 31 07:28:06.641233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641207    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.641402 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641239    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.641402 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641307    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 07:28:06.641536 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641524    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2nzlr\""
Oct 31 07:28:06.641931 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641898    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Oct 31 07:28:06.642023 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.641991    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.642440 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.642418    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.642589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.642571    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.642714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.642695    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Oct 31 07:28:06.643105 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.643087    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Oct 31 07:28:06.643199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.643140    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.643334 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.643307    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 07:28:06.643398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.643346    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.643584 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.643569    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 07:28:06.643735 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.643710    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 07:28:06.643903 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.643885    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 07:28:06.643996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.643578    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.644106 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.644088    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-548vl\""
Oct 31 07:28:06.644303 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.644287    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-vgg5g\""
Oct 31 07:28:06.644373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.644316    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.644488 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.644473    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 07:28:06.644646 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.644525    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.644793 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.644776    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.644793 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.644782    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.644982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.644967    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.645179 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645156    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.645255 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645198    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.645305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.644970    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.645350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645328    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.645493 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645473    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 07:28:06.645593 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645574    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 07:28:06.645785 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645770    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.645897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645877    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Oct 31 07:28:06.645973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645898    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.645973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645908    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.645973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645945    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.645973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645780    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x6ssn\""
Oct 31 07:28:06.646139 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645823    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.646139 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645813    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.646139 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645857    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hgtls\""
Oct 31 07:28:06.646139 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.646022    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.646139 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645821    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Oct 31 07:28:06.646361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645778    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.646361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645853    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-config\""
Oct 31 07:28:06.646361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.645852    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.646361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.646354    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p7l5b\""
Oct 31 07:28:06.651285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.651263    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-qk9pc\""
Oct 31 07:28:06.651373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.651264    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 07:28:06.651373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.651264    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 07:28:06.651373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.651289    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gjb5j\""
Oct 31 07:28:06.651373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.651315    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 07:28:06.651373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.651328    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 07:28:06.651996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.651981    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.652036 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.651991    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.652238 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.652223    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.652275 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.652251    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.652275 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.652262    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 07:28:06.652354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.652332    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.652850 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.652828    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Oct 31 07:28:06.652948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.652868    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Oct 31 07:28:06.652948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.652870    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s5wtg\""
Oct 31 07:28:06.653066 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.652965    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Oct 31 07:28:06.653066 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.653034    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 07:28:06.653488 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.653454    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Oct 31 07:28:06.653488 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.653466    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 07:28:06.653599 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.653509    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xtmc6\""
Oct 31 07:28:06.654321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.654305    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Oct 31 07:28:06.654397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.654354    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Oct 31 07:28:06.654493 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.654478    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-wkhqf\""
Oct 31 07:28:06.654493 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.654488    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vhq6\""
Oct 31 07:28:06.654599 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.654494    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5ktk8\""
Oct 31 07:28:06.654599 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.654514    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kxp8c\""
Oct 31 07:28:06.654774 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.654759    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mx89s\""
Oct 31 07:28:06.654830 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.654777    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cnphn\""
Oct 31 07:28:06.655086 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.655071    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dql9j\""
Oct 31 07:28:06.655345 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.655332    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 07:28:06.655552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.655539    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 07:28:06.656226 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.656212    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Oct 31 07:28:06.656694 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.656682    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Oct 31 07:28:06.656778 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.656762    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Oct 31 07:28:06.656827 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.656815    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Oct 31 07:28:06.656827 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.656819    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Oct 31 07:28:06.656932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.656872    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-bbr4n\""
Oct 31 07:28:06.656932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.656899    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Oct 31 07:28:06.657224 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.657209    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Oct 31 07:28:06.677380 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.677357    5039 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.677505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.677494    5039 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.678650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.678633    5039 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 07:28:06.697418 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.697395    5039 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:28:06.697514 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.697444    5039 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-128-20.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.697773 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.697760    5039 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 07:28:06.697807 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.697792    5039 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-20.ec2.internal"
Oct 31 07:28:06.725903 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.725874    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxr9\" (UniqueName: \"kubernetes.io/projected/4820d461-a6e0-49fe-a57c-dbff7bc255f8-kube-api-access-mrxr9\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:28:06.726034 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.725906    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-systemd\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.726034 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.725948    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-netns\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.726127 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726053    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-config\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.726127 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726093    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.726127 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726121    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-data-volume\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.726266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726146    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vg8q5\" (UniqueName: \"kubernetes.io/projected/513eea23-470d-4236-ae17-1666a54ce63f-kube-api-access-vg8q5\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.726266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726170    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-cni-binary-copy\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.726266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726192    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-service-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.726266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726217    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.726266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726231    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.726266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726241    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.726525 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726271    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-data-volume\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.726525 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726465    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248978c-acdb-47f0-b702-c0029711230d-tmp-dir\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:06.726525 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726478    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-config\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.726525 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726502    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd52j\" (UniqueName: \"kubernetes.io/projected/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-api-access-rd52j\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726536    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-system-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726478    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726545    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-cni-binary-copy\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726563    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-daemon-config\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726536    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726590    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-trusted-ca\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726580    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e248978c-acdb-47f0-b702-c0029711230d-tmp-dir\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726619    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-kubelet\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726642    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-cabundle\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726680    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.726707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726702    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-ovn\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726716    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-netd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726727    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-daemon-config\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726740    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f49g\" (UniqueName: \"kubernetes.io/projected/9a46a25a-59fe-4cd2-8566-4203c84b5175-kube-api-access-8f49g\") pod \"network-check-source-6f78d59f99-clcqg\" (UID: \"9a46a25a-59fe-4cd2-8566-4203c84b5175\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726783    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-sys-fs\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726821    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726895    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-trusted-ca\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726945    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.726946    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-cabundle\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727037    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-service-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727086    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-k8s-cni-cncf-io\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727115    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727127    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-multus-certs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727162    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrth6\" (UniqueName: \"kubernetes.io/projected/f2d1eb29-7f18-41ee-949d-33892c4b30c1-kube-api-access-vrth6\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727183    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4820d461-a6e0-49fe-a57c-dbff7bc255f8-iptables-alerter-script\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727220    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9kb7\" (UniqueName: \"kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:06.727285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727282    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-key\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727300    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727324    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727345    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccea0fe7-8780-408e-b799-299e44328b4f-serving-cert\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727390    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727424    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-konnectivity-ca\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727440    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4820d461-a6e0-49fe-a57c-dbff7bc255f8-iptables-alerter-script\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727451    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727467    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727478    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-stats-auth\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727525    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727556    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ccea0fe7-8780-408e-b799-299e44328b4f-serving-cert\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727558    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727559    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-registration-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727608    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/078fdc95-76b1-4323-9985-905f939dbbc4-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727640    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71156071-2868-4bea-8ba9-20f9e073d996-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727673    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727692    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-socket-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727700    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-stats-auth\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727715    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727735    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727792    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d8753ed2-8968-47dc-aae5-6abc034f7435-signing-key\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727810    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58wkr\" (UniqueName: \"kubernetes.io/projected/735f0bbc-22c2-4f33-af0d-6fc10cda9e17-kube-api-access-58wkr\") pod \"kas-connection-checker-685895c7c9-2qw6l\" (UID: \"735f0bbc-22c2-4f33-af0d-6fc10cda9e17\") " pod="kube-system/kas-connection-checker-685895c7c9-2qw6l"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727845    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727906    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-kubelet\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.727971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727973    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-konnectivity-ca\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727973    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/078fdc95-76b1-4323-9985-905f939dbbc4-telemetry-config\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.727996    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/904b6555-9c6d-4489-9b17-0d96d5fe2c12-serving-cert\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728023    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/71156071-2868-4bea-8ba9-20f9e073d996-serving-cert\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728055    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbnpr\" (UniqueName: \"kubernetes.io/projected/a2320145-3aab-44be-a1c2-7912c2498c30-kube-api-access-sbnpr\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728045    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/508a0686-e4c7-472a-b608-d270a7dbce3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728089    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728112    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z2c6\" (UniqueName: \"kubernetes.io/projected/e248978c-acdb-47f0-b702-c0029711230d-kube-api-access-4z2c6\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728137    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-snapshots\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728163    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsx85\" (UniqueName: \"kubernetes.io/projected/508a0686-e4c7-472a-b608-d270a7dbce3d-kube-api-access-nsx85\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728192    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-var-lib-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728230    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-snapshots\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728165    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/904b6555-9c6d-4489-9b17-0d96d5fe2c12-serving-cert\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728241    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728297    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-slash\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728332    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728343    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/904b6555-9c6d-4489-9b17-0d96d5fe2c12-trusted-ca-bundle\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728359    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/408136c3-732d-4564-a1f8-c969888f361d-hosts-file\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728403    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvs8d\" (UniqueName: \"kubernetes.io/projected/078fdc95-76b1-4323-9985-905f939dbbc4-kube-api-access-lvs8d\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728455    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stqt2\" (UniqueName: \"kubernetes.io/projected/aec5e525-a7f4-460d-aceb-f8412e0c3b2b-kube-api-access-stqt2\") pod \"migrator-66df5d496b-vx9p9\" (UID: \"aec5e525-a7f4-460d-aceb-f8412e0c3b2b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728535    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-agent-certs\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728608    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-dbus\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728646    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4820d461-a6e0-49fe-a57c-dbff7bc255f8-host-slash\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728696    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4vtt\" (UniqueName: \"kubernetes.io/projected/29654c5b-afac-4935-b729-3e5b5c8adf50-kube-api-access-g4vtt\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728704    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728734    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-system-cni-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728763    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728763    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e9d4b049-ebbe-4c4f-b792-d74110bc6ec0-agent-certs\") pod \"konnectivity-agent-kwmnp\" (UID: \"e9d4b049-ebbe-4c4f-b792-d74110bc6ec0\") " pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728791    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.728890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728896    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2v55\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728940    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b351b59-c90b-42cb-87b1-228f83da0488-serving-cert\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.728973    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e248978c-acdb-47f0-b702-c0029711230d-config-volume\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729003    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-conf\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729031    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovn-node-metrics-cert\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729058    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729080    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6b351b59-c90b-42cb-87b1-228f83da0488-serving-cert\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729135    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729168    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729185    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729187    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e248978c-acdb-47f0-b702-c0029711230d-config-volume\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729203    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729233    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t96md\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729373    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-kubernetes\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729407    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-tuned\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729420    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovn-node-metrics-cert\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729446    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-etc-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729467    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729486    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-cert\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729499    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-tuned\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729531    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-tmp\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729634    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-systemd-units\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729665    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-cert\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729679    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/904b6555-9c6d-4489-9b17-0d96d5fe2c12-tmp\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729717    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjfgb\" (UniqueName: \"kubernetes.io/projected/71156071-2868-4bea-8ba9-20f9e073d996-kube-api-access-zjfgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.729829    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730176    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-hostroot\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730215    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-kubelet-config\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730219    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.730320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730257    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730385    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730479    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730523    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730570    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-socket-dir-parent\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730608    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-config\" (UniqueName: \"kubernetes.io/configmap/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-config\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730626    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-log-socket\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730678    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730709    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-script-lib\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730744    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24qkk\" (UniqueName: \"kubernetes.io/projected/408136c3-732d-4564-a1f8-c969888f361d-kube-api-access-24qkk\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730781    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a867c49-34bc-4114-8ee9-c3f30900d501-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.730970    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-ovnkube-script-lib\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731162    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731251    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrmzs\" (UniqueName: \"kubernetes.io/projected/06e7dac1-d91c-4928-bbca-a4d1535e2170-kube-api-access-lrmzs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731295    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggnwk\" (UniqueName: \"kubernetes.io/projected/904b6555-9c6d-4489-9b17-0d96d5fe2c12-kube-api-access-ggnwk\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731327    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7775h\" (UniqueName: \"kubernetes.io/projected/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-kube-api-access-7775h\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731381    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhb2p\" (UniqueName: \"kubernetes.io/projected/680bd2c4-08ae-4e24-a6c0-37339d826971-kube-api-access-bhb2p\") pod \"volume-data-source-validator-58c9f5f46d-g72nq\" (UID: \"680bd2c4-08ae-4e24-a6c0-37339d826971\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731432    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysconfig\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731462    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk4bt\" (UniqueName: \"kubernetes.io/projected/5a3e7931-f6a9-419d-8cce-5c884e627036-kube-api-access-gk4bt\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731509    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-multus\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.731548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731545    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-modprobe-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731589    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-bin\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731588    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731696    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-device-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731738    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-netns\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731781    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-conf-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731817    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79qlm\" (UniqueName: \"kubernetes.io/projected/ccea0fe7-8780-408e-b799-299e44328b4f-kube-api-access-79qlm\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731853    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-var-lib-kubelet\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731892    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-sys\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731946    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2a867c49-34bc-4114-8ee9-c3f30900d501-nginx-conf\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.731956    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk28k\" (UniqueName: \"kubernetes.io/projected/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-kube-api-access-nk28k\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732025    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-default-certificate\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732282    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-default-certificate\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732336    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732368    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-config\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732401    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:06.732431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732434    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-lib-modules\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732460    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732493    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732634    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk4xv\" (UniqueName: \"kubernetes.io/projected/6b351b59-c90b-42cb-87b1-228f83da0488-kube-api-access-hk4xv\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732670    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732704    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732733    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4kdq\" (UniqueName: \"kubernetes.io/projected/4167bdf8-9b23-482d-805f-c6fdeeda5384-kube-api-access-k4kdq\") pod \"kas-connection-checker-685895c7c9-r4hl6\" (UID: \"4167bdf8-9b23-482d-805f-c6fdeeda5384\") " pod="kube-system/kas-connection-checker-685895c7c9-r4hl6"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732765    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-host\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732794    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-systemd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732825    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-etc-kubernetes\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732858    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvpd\" (UniqueName: \"kubernetes.io/projected/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-kube-api-access-prvpd\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732882    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-cnibin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.733075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.732930    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2d1eb29-7f18-41ee-949d-33892c4b30c1-host\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:28:06.733605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.733268    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:28:06.733605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.733308    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46h8f\" (UniqueName: \"kubernetes.io/projected/a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb-kube-api-access-46h8f\") pod \"kas-connection-checker-685895c7c9-zl6kk\" (UID: \"a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb\") " pod="kube-system/kas-connection-checker-685895c7c9-zl6kk"
Oct 31 07:28:06.733605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.733344    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px9bt\" (UniqueName: \"kubernetes.io/projected/6330753d-1f92-46d9-a1ff-70262d02c414-kube-api-access-px9bt\") pod \"migrator-66df5d496b-hdrmp\" (UID: \"6330753d-1f92-46d9-a1ff-70262d02c414\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"
Oct 31 07:28:06.733728 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.733654    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.733728 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.733712    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:06.733816 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.733783    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.734750    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.734757    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ccea0fe7-8780-408e-b799-299e44328b4f-config\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.734789    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.734829    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71156071-2868-4bea-8ba9-20f9e073d996-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.734954    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735000    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-crio-socket\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735025    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/71156071-2868-4bea-8ba9-20f9e073d996-config\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735048    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735091    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-cnibin\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735159    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-node-log\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735188    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-env-overrides\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735288    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408136c3-732d-4564-a1f8-c969888f361d-tmp-dir\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:28:06.735381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735336    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/21fea0a5-efb9-4b1a-b561-d173b3ad6169-original-pull-secret\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:28:06.735847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735364    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwvrx\" (UniqueName: \"kubernetes.io/projected/d8753ed2-8968-47dc-aae5-6abc034f7435-kube-api-access-dwvrx\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:06.735847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735464    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/408136c3-732d-4564-a1f8-c969888f361d-tmp-dir\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:28:06.735847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735472    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-env-overrides\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.735847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735495    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-run\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.735847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735523    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b351b59-c90b-42cb-87b1-228f83da0488-config\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:28:06.736040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.735979    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.736040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.736029    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-bin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.736110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.736062    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-tmp\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.736110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.736075    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6b351b59-c90b-42cb-87b1-228f83da0488-config\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:28:06.736110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.736090    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2d1eb29-7f18-41ee-949d-33892c4b30c1-serviceca\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:28:06.736207 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.736173    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29654c5b-afac-4935-b729-3e5b5c8adf50-tmp\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.736279 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.736262    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2d1eb29-7f18-41ee-949d-33892c4b30c1-serviceca\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:28:06.742592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.742573    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd52j\" (UniqueName: \"kubernetes.io/projected/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-kube-api-access-rd52j\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.742868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.742851    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxr9\" (UniqueName: \"kubernetes.io/projected/4820d461-a6e0-49fe-a57c-dbff7bc255f8-kube-api-access-mrxr9\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:28:06.743007 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.742984    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vg8q5\" (UniqueName: \"kubernetes.io/projected/513eea23-470d-4236-ae17-1666a54ce63f-kube-api-access-vg8q5\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.745136 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.745115    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrth6\" (UniqueName: \"kubernetes.io/projected/f2d1eb29-7f18-41ee-949d-33892c4b30c1-kube-api-access-vrth6\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:28:06.745393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.745375    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f49g\" (UniqueName: \"kubernetes.io/projected/9a46a25a-59fe-4cd2-8566-4203c84b5175-kube-api-access-8f49g\") pod \"network-check-source-6f78d59f99-clcqg\" (UID: \"9a46a25a-59fe-4cd2-8566-4203c84b5175\") " pod="openshift-network-diagnostics/network-check-source-6f78d59f99-clcqg"
Oct 31 07:28:06.745451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.745395    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9kb7\" (UniqueName: \"kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7\") pod \"periodic-gathering-t6jrq-6cxmm\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") " pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:28:06.746358 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.746335    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stqt2\" (UniqueName: \"kubernetes.io/projected/aec5e525-a7f4-460d-aceb-f8412e0c3b2b-kube-api-access-stqt2\") pod \"migrator-66df5d496b-vx9p9\" (UID: \"aec5e525-a7f4-460d-aceb-f8412e0c3b2b\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-vx9p9"
Oct 31 07:28:06.746445 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.746431    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvs8d\" (UniqueName: \"kubernetes.io/projected/078fdc95-76b1-4323-9985-905f939dbbc4-kube-api-access-lvs8d\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:06.747239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.746975    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58wkr\" (UniqueName: \"kubernetes.io/projected/735f0bbc-22c2-4f33-af0d-6fc10cda9e17-kube-api-access-58wkr\") pod \"kas-connection-checker-685895c7c9-2qw6l\" (UID: \"735f0bbc-22c2-4f33-af0d-6fc10cda9e17\") " pod="kube-system/kas-connection-checker-685895c7c9-2qw6l"
Oct 31 07:28:06.747239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.747154    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbnpr\" (UniqueName: \"kubernetes.io/projected/a2320145-3aab-44be-a1c2-7912c2498c30-kube-api-access-sbnpr\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:28:06.747239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.747183    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t96md\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.747529 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.747506    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsx85\" (UniqueName: \"kubernetes.io/projected/508a0686-e4c7-472a-b608-d270a7dbce3d-kube-api-access-nsx85\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.747722 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.747704    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z2c6\" (UniqueName: \"kubernetes.io/projected/e248978c-acdb-47f0-b702-c0029711230d-kube-api-access-4z2c6\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:06.747798 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.747712    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2v55\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.748289 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.748273    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-dtncg_71156071-2868-4bea-8ba9-20f9e073d996/kube-storage-version-migrator-operator/0.log"
Oct 31 07:28:06.749091 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.749070    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24qkk\" (UniqueName: \"kubernetes.io/projected/408136c3-732d-4564-a1f8-c969888f361d-kube-api-access-24qkk\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:28:06.749215 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.749196    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.749297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.749280    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjfgb\" (UniqueName: \"kubernetes.io/projected/71156071-2868-4bea-8ba9-20f9e073d996-kube-api-access-zjfgb\") pod \"kube-storage-version-migrator-operator-7d4bc45dd6-dtncg\" (UID: \"71156071-2868-4bea-8ba9-20f9e073d996\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg"
Oct 31 07:28:06.749463 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.749447    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4vtt\" (UniqueName: \"kubernetes.io/projected/29654c5b-afac-4935-b729-3e5b5c8adf50-kube-api-access-g4vtt\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.749529 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.749514    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dq2z7\" (UniqueName: \"kubernetes.io/projected/647db033-e901-4100-b8a0-a60948730917-kube-api-access-dq2z7\") pod \"network-check-target-mtrsf\" (UID: \"647db033-e901-4100-b8a0-a60948730917\") " pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:28:06.750597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.750580    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7775h\" (UniqueName: \"kubernetes.io/projected/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-kube-api-access-7775h\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.750936 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.750906    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvpd\" (UniqueName: \"kubernetes.io/projected/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-kube-api-access-prvpd\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.751700 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.751685    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px9bt\" (UniqueName: \"kubernetes.io/projected/6330753d-1f92-46d9-a1ff-70262d02c414-kube-api-access-px9bt\") pod \"migrator-66df5d496b-hdrmp\" (UID: \"6330753d-1f92-46d9-a1ff-70262d02c414\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-hdrmp"
Oct 31 07:28:06.751933 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.751897    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk4bt\" (UniqueName: \"kubernetes.io/projected/5a3e7931-f6a9-419d-8cce-5c884e627036-kube-api-access-gk4bt\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:06.752012 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.751991    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79qlm\" (UniqueName: \"kubernetes.io/projected/ccea0fe7-8780-408e-b799-299e44328b4f-kube-api-access-79qlm\") pod \"console-operator-7cd56b8dbc-bqnjc\" (UID: \"ccea0fe7-8780-408e-b799-299e44328b4f\") " pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:06.752163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.752143    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4kdq\" (UniqueName: \"kubernetes.io/projected/4167bdf8-9b23-482d-805f-c6fdeeda5384-kube-api-access-k4kdq\") pod \"kas-connection-checker-685895c7c9-r4hl6\" (UID: \"4167bdf8-9b23-482d-805f-c6fdeeda5384\") " pod="kube-system/kas-connection-checker-685895c7c9-r4hl6"
Oct 31 07:28:06.752388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.752368    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.752465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.752438    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk4xv\" (UniqueName: \"kubernetes.io/projected/6b351b59-c90b-42cb-87b1-228f83da0488-kube-api-access-hk4xv\") pod \"service-ca-operator-544d749c8c-mbxx9\" (UID: \"6b351b59-c90b-42cb-87b1-228f83da0488\") " pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9"
Oct 31 07:28:06.752465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.752455    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrmzs\" (UniqueName: \"kubernetes.io/projected/06e7dac1-d91c-4928-bbca-a4d1535e2170-kube-api-access-lrmzs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.752644 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.752626    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46h8f\" (UniqueName: \"kubernetes.io/projected/a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb-kube-api-access-46h8f\") pod \"kas-connection-checker-685895c7c9-zl6kk\" (UID: \"a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb\") " pod="kube-system/kas-connection-checker-685895c7c9-zl6kk"
Oct 31 07:28:06.752974 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.752958    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggnwk\" (UniqueName: \"kubernetes.io/projected/904b6555-9c6d-4489-9b17-0d96d5fe2c12-kube-api-access-ggnwk\") pod \"insights-operator-7c4986d449-6krlj\" (UID: \"904b6555-9c6d-4489-9b17-0d96d5fe2c12\") " pod="openshift-insights/insights-operator-7c4986d449-6krlj"
Oct 31 07:28:06.753163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.753143    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhb2p\" (UniqueName: \"kubernetes.io/projected/680bd2c4-08ae-4e24-a6c0-37339d826971-kube-api-access-bhb2p\") pod \"volume-data-source-validator-58c9f5f46d-g72nq\" (UID: \"680bd2c4-08ae-4e24-a6c0-37339d826971\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-58c9f5f46d-g72nq"
Oct 31 07:28:06.753262 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.753249    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwvrx\" (UniqueName: \"kubernetes.io/projected/d8753ed2-8968-47dc-aae5-6abc034f7435-kube-api-access-dwvrx\") pod \"service-ca-5fffc97bdf-6ggm8\" (UID: \"d8753ed2-8968-47dc-aae5-6abc034f7435\") " pod="openshift-service-ca/service-ca-5fffc97bdf-6ggm8"
Oct 31 07:28:06.753865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.753850    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk28k\" (UniqueName: \"kubernetes.io/projected/5d6e9a9a-37e4-4f68-975d-fada2cfc80ec-kube-api-access-nk28k\") pod \"ingress-canary-rw59c\" (UID: \"5d6e9a9a-37e4-4f68-975d-fada2cfc80ec\") " pod="openshift-ingress-canary/ingress-canary-rw59c"
Oct 31 07:28:06.836800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836708    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.836800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836746    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.836800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836767    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:06.836800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836791    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-kubernetes\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836814    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-etc-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836836    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836863    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.836889    5039 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.836932    5039 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb764d49-7pjn2: secret "image-registry-tls" not found
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836935    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-etc-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836962    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-kubernetes\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836970    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-systemd-units\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.836875    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-systemd-units\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.837052    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls podName:ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:07.337029583 +0000 UTC m=+1.866224257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls") pod "image-registry-5cb764d49-7pjn2" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6") : secret "image-registry-tls" not found
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.837076    5039 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837104    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-hostroot\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.837145    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls podName:078fdc95-76b1-4323-9985-905f939dbbc4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:07.337129304 +0000 UTC m=+1.866323973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-84prv" (UID: "078fdc95-76b1-4323-9985-905f939dbbc4") : secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:06.837156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837078    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-hostroot\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837185    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-kubelet-config\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837191    5039 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837225    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837244    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-socket-dir-parent\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837274    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-log-socket\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837293    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-kubelet-config\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837309    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-log-socket\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837326    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-socket-dir-parent\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837342    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837370    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysconfig\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837406    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837420    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-multus\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837446    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-modprobe-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837453    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysconfig\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837481    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-bin\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837493    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-multus\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837503    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-device-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837539    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-netns\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837560    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-device-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837563    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-bin\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837565    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-conf-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837593    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-netns\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837600    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-conf-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837608    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-var-lib-kubelet\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837637    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-modprobe-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837647    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-var-lib-kubelet\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837648    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-sys\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837691    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-lib-modules\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837709    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-sys\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837722    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:06.837726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837749    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-host\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837772    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-systemd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837795    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-etc-kubernetes\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837801    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-lib-modules\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837819    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-cnibin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.837835    5039 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837841    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-systemd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837844    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2d1eb29-7f18-41ee-949d-33892c4b30c1-host\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837867    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-service-ca-bundle\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837873    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2d1eb29-7f18-41ee-949d-33892c4b30c1-host\") pod \"node-ca-8498p\" (UID: \"f2d1eb29-7f18-41ee-949d-33892c4b30c1\") " pod="openshift-image-registry/node-ca-8498p"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837875    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.837883    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert podName:2a867c49-34bc-4114-8ee9-c3f30900d501 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:07.337868972 +0000 UTC m=+1.867063647 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pplb8" (UID: "2a867c49-34bc-4114-8ee9-c3f30900d501") : secret "networking-console-plugin-cert" not found
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837935    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-cnibin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837945    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-etc-kubernetes\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837970    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-crio-socket\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837980    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-host\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.837998    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-cnibin\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838023    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-node-log\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838034    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-crio-socket\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838056    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-run\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838068    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-cnibin\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838077    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-node-log\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838100    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838113    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-run\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838127    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-bin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838153    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-systemd\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.838172    5039 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838175    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-netns\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838181    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-cni-bin\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.838213    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:07.338200478 +0000 UTC m=+1.867395146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838230    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-system-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838233    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-netns\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838260    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-kubelet\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838262    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-systemd\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838288    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838296    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-system-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838291    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-kubelet\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838312    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-ovn\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838322    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838337    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-netd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838358    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-run-ovn\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838364    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-sys-fs\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838388    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838396    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-cni-netd\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838414    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-k8s-cni-cncf-io\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838438    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-multus-certs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838446    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-sys-fs\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838453    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-multus-cni-dir\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838478    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-k8s-cni-cncf-io\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838467    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838492    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-run-multus-certs\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838534    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838560    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838584    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-registration-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.838536    5039 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838610    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.838640    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls podName:e248978c-acdb-47f0-b702-c0029711230d nodeName:}" failed. No retries permitted until 2026-10-31 07:28:07.338630372 +0000 UTC m=+1.867825077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls") pod "dns-default-b4zz8" (UID: "e248978c-acdb-47f0-b702-c0029711230d") : secret "dns-default-metrics-tls" not found
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838634    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-socket-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838662    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838678    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-socket-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838683    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-kubelet\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838719    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838740    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-var-lib-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838768    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838788    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-slash\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.838805    5039 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838807    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838742    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-registration-dir\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838831    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/408136c3-732d-4564-a1f8-c969888f361d-hosts-file\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838852    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/06e7dac1-d91c-4928-bbca-a4d1535e2170-host-var-lib-kubelet\") pod \"multus-j9f7v\" (UID: \"06e7dac1-d91c-4928-bbca-a4d1535e2170\") " pod="openshift-multus/multus-j9f7v"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838858    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-dbus\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838868    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-d\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838883    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4820d461-a6e0-49fe-a57c-dbff7bc255f8-host-slash\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838889    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-var-lib-openvswitch\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838931    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-run-ovn-kubernetes\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838941    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265-host-slash\") pod \"ovnkube-node-kqq5l\" (UID: \"2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265\") " pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838930    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-system-cni-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838968    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/513eea23-470d-4236-ae17-1666a54ce63f-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfnms\" (UID: \"513eea23-470d-4236-ae17-1666a54ce63f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfnms"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838986    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-conf\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.838815    5039 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b48874d4-s59mc: secret "image-registry-tls" not found
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838999    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/21fea0a5-efb9-4b1a-b561-d173b3ad6169-dbus\") pod \"global-pull-secret-syncer-qpskk\" (UID: \"21fea0a5-efb9-4b1a-b561-d173b3ad6169\") " pod="kube-system/global-pull-secret-syncer-qpskk"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.839018    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/508a0686-e4c7-472a-b608-d270a7dbce3d-system-cni-dir\") pod \"multus-additional-cni-plugins-6ktj5\" (UID: \"508a0686-e4c7-472a-b608-d270a7dbce3d\") " pod="openshift-multus/multus-additional-cni-plugins-6ktj5"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.838987    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/408136c3-732d-4564-a1f8-c969888f361d-hosts-file\") pod \"node-resolver-hzt8h\" (UID: \"408136c3-732d-4564-a1f8-c969888f361d\") " pod="openshift-dns/node-resolver-hzt8h"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:06.839037    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls podName:9f39613d-2e12-4ac7-a5d3-e6429b3b874f nodeName:}" failed. No retries permitted until 2026-10-31 07:28:07.339021158 +0000 UTC m=+1.868215815 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls") pod "image-registry-59b48874d4-s59mc" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f") : secret "image-registry-tls" not found
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.839062    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4820d461-a6e0-49fe-a57c-dbff7bc255f8-host-slash\") pod \"iptables-alerter-jm95s\" (UID: \"4820d461-a6e0-49fe-a57c-dbff7bc255f8\") " pod="openshift-network-operator/iptables-alerter-jm95s"
Oct 31 07:28:06.839208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.839164    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29654c5b-afac-4935-b729-3e5b5c8adf50-etc-sysctl-conf\") pod \"tuned-xmjdj\" (UID: \"29654c5b-afac-4935-b729-3e5b5c8adf50\") " pod="openshift-cluster-node-tuning-operator/tuned-xmjdj"
Oct 31 07:28:06.842000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.839811    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4118a0cf-82b9-4bf6-a953-3af32ca0b5f4-metrics-certs\") pod \"router-default-79b9f58c8f-wd2zk\" (UID: \"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4\") " pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.842000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.840560    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2320145-3aab-44be-a1c2-7912c2498c30-metrics-certs\") pod \"network-metrics-daemon-fkcpf\" (UID: \"a2320145-3aab-44be-a1c2-7912c2498c30\") " pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:28:06.842000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.840870    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/5a3e7931-f6a9-419d-8cce-5c884e627036-samples-operator-tls\") pod \"cluster-samples-operator-6ddb6c8b94-nl4vc\" (UID: \"5a3e7931-f6a9-419d-8cce-5c884e627036\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:06.910590 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.910551    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:06.916550 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.916530    5039 scope.go:122] "RemoveContainer" containerID="8aa4269ad04c105f09c29b6f6eed542dfd65d6118a3d56cb4e80acb23f0984e6"
Oct 31 07:28:06.917868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.917850    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"
Oct 31 07:28:06.921666 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.921646    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:06.927397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:06.927368    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fkcpf"
Oct 31 07:28:07.231487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.231446    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc"]
Oct 31 07:28:07.240642 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.240618    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-79b9f58c8f-wd2zk"]
Oct 31 07:28:07.245056 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.245028    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fkcpf"]
Oct 31 07:28:07.250135 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:07.250106    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4118a0cf_82b9_4bf6_a953_3af32ca0b5f4.slice/crio-283feacc61672a0cd01449119bc99f211df4fd6efcc18518404cff02ed8937c7 WatchSource:0}: Error finding container 283feacc61672a0cd01449119bc99f211df4fd6efcc18518404cff02ed8937c7: Status 404 returned error can't find the container with id 283feacc61672a0cd01449119bc99f211df4fd6efcc18518404cff02ed8937c7
Oct 31 07:28:07.250946 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:07.250897    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2320145_3aab_44be_a1c2_7912c2498c30.slice/crio-5d49e3c37e53723877d2c39b84b5bb8273df6a86e8b84922e5d4fea9dcb21b26 WatchSource:0}: Error finding container 5d49e3c37e53723877d2c39b84b5bb8273df6a86e8b84922e5d4fea9dcb21b26: Status 404 returned error can't find the container with id 5d49e3c37e53723877d2c39b84b5bb8273df6a86e8b84922e5d4fea9dcb21b26
Oct 31 07:28:07.253073 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.253051    5039 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 07:28:07.309960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.309907    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:07.342825 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.342787    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:07.343004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.342840    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:07.343004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.342899    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:07.343004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.342956    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:07.343004 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.342985    5039 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343012    5039 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb764d49-7pjn2: secret "image-registry-tls" not found
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343048    5039 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343072    5039 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.343011    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343148    5039 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343163    5039 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343076    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls podName:ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:08.343055266 +0000 UTC m=+2.872249935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls") pod "image-registry-5cb764d49-7pjn2" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6") : secret "image-registry-tls" not found
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343197    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls podName:e248978c-acdb-47f0-b702-c0029711230d nodeName:}" failed. No retries permitted until 2026-10-31 07:28:08.343182366 +0000 UTC m=+2.872377019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls") pod "dns-default-b4zz8" (UID: "e248978c-acdb-47f0-b702-c0029711230d") : secret "dns-default-metrics-tls" not found
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343212    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls podName:078fdc95-76b1-4323-9985-905f939dbbc4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:08.343205689 +0000 UTC m=+2.872400341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-84prv" (UID: "078fdc95-76b1-4323-9985-905f939dbbc4") : secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:07.343221 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343223    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert podName:2a867c49-34bc-4114-8ee9-c3f30900d501 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:08.343218292 +0000 UTC m=+2.872412944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pplb8" (UID: "2a867c49-34bc-4114-8ee9-c3f30900d501") : secret "networking-console-plugin-cert" not found
Oct 31 07:28:07.343703 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343233    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:08.343228762 +0000 UTC m=+2.872423414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:07.343703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.343254    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:07.343703 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343370    5039 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:28:07.343703 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343380    5039 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b48874d4-s59mc: secret "image-registry-tls" not found
Oct 31 07:28:07.343703 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:07.343401    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls podName:9f39613d-2e12-4ac7-a5d3-e6429b3b874f nodeName:}" failed. No retries permitted until 2026-10-31 07:28:08.343395063 +0000 UTC m=+2.872589715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls") pod "image-registry-59b48874d4-s59mc" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f") : secret "image-registry-tls" not found
Oct 31 07:28:07.508816 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.508733    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:07.672435 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.672397    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:07.684341 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.684276    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc" event={"ID":"5a3e7931-f6a9-419d-8cce-5c884e627036","Type":"ContainerStarted","Data":"2cd1dd77957f01da1992e5703d83b2b660b6c36a1109151a02e41c6ffda31930"}
Oct 31 07:28:07.691331 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.691301    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:28:07.691700 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.691599    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc" event={"ID":"ccea0fe7-8780-408e-b799-299e44328b4f","Type":"ContainerStarted","Data":"a559c573b88f4ddf2d485e5c044a1ff89e3105553adbc71de39b367f7e4dc97b"}
Oct 31 07:28:07.696945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.693652    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fkcpf" event={"ID":"a2320145-3aab-44be-a1c2-7912c2498c30","Type":"ContainerStarted","Data":"5d49e3c37e53723877d2c39b84b5bb8273df6a86e8b84922e5d4fea9dcb21b26"}
Oct 31 07:28:07.700527 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.700499    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79b9f58c8f-wd2zk" event={"ID":"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4","Type":"ContainerStarted","Data":"6ebf24faeb0651c89b6e7726bde79e2b722ecd6b791b6d40eeba3a6d2f90ae7b"}
Oct 31 07:28:07.700671 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.700545    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-79b9f58c8f-wd2zk" event={"ID":"4118a0cf-82b9-4bf6-a953-3af32ca0b5f4","Type":"ContainerStarted","Data":"283feacc61672a0cd01449119bc99f211df4fd6efcc18518404cff02ed8937c7"}
Oct 31 07:28:07.781788 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.781701    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:07.897305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.897274    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:07.922651 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.922621    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:07.925393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:07.925365    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:08.012374 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.012338    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:08.121180 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.121093    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:08.355240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.355208    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:08.355361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.355266    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:08.355361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.355332    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:08.355440 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355357    5039 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 07:28:08.355440 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.355367    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:08.355440 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355404    5039 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:28:08.355440 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355424    5039 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b48874d4-s59mc: secret "image-registry-tls" not found
Oct 31 07:28:08.355440 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355430    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls podName:e248978c-acdb-47f0-b702-c0029711230d nodeName:}" failed. No retries permitted until 2026-10-31 07:28:10.355408009 +0000 UTC m=+4.884602682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls") pod "dns-default-b4zz8" (UID: "e248978c-acdb-47f0-b702-c0029711230d") : secret "dns-default-metrics-tls" not found
Oct 31 07:28:08.355582 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355454    5039 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Oct 31 07:28:08.355582 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355468    5039 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5cb764d49-7pjn2: secret "image-registry-tls" not found
Oct 31 07:28:08.355582 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355475    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls podName:9f39613d-2e12-4ac7-a5d3-e6429b3b874f nodeName:}" failed. No retries permitted until 2026-10-31 07:28:10.355458705 +0000 UTC m=+4.884653375 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls") pod "image-registry-59b48874d4-s59mc" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f") : secret "image-registry-tls" not found
Oct 31 07:28:08.355582 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355483    5039 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:08.355582 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355504    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls podName:ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:10.355492149 +0000 UTC m=+4.884686837 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls") pod "image-registry-5cb764d49-7pjn2" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6") : secret "image-registry-tls" not found
Oct 31 07:28:08.355582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.355498    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:08.355582 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355531    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls podName:078fdc95-76b1-4323-9985-905f939dbbc4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:10.355517399 +0000 UTC m=+4.884712074 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-84prv" (UID: "078fdc95-76b1-4323-9985-905f939dbbc4") : secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:08.355582 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355556    5039 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Oct 31 07:28:08.355866 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.355581    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:08.355866 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355645    5039 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:08.355954 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355942    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert podName:2a867c49-34bc-4114-8ee9-c3f30900d501 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:10.355580291 +0000 UTC m=+4.884774977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert") pod "networking-console-plugin-86c478bb88-pplb8" (UID: "2a867c49-34bc-4114-8ee9-c3f30900d501") : secret "networking-console-plugin-cert" not found
Oct 31 07:28:08.355996 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:08.355985    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:10.355964694 +0000 UTC m=+4.885159359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:08.706128 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.706060    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fkcpf" event={"ID":"a2320145-3aab-44be-a1c2-7912c2498c30","Type":"ContainerStarted","Data":"c3f9699cedc99b53cdc9716c66820b1c5eb31ba2870f39be8887f6d55d490bd7"}
Oct 31 07:28:08.706597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.706168    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fkcpf" event={"ID":"a2320145-3aab-44be-a1c2-7912c2498c30","Type":"ContainerStarted","Data":"ca966598bad2353c7e79556511c542e90151837dbc717736cd927a23fe46a2d8"}
Oct 31 07:28:08.897107 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.897069    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:08.937747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.937722    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:08.937881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.937868    5039 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:28:08.942053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:08.942028    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7cd56b8dbc-bqnjc"
Oct 31 07:28:09.308311 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.308219    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:09.361082 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.361046    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:28:09.496062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.496030    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:09.611391 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.611283    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:09.711434 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.711397    5039 generic.go:356] "Generic (PLEG): container finished" podID="71156071-2868-4bea-8ba9-20f9e073d996" containerID="3c39ef7ae1813d5a2497ec8c45b278a00dea42aebd20ab2c25de96e29cebd051" exitCode=0
Oct 31 07:28:09.711877 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.711465    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg" event={"ID":"71156071-2868-4bea-8ba9-20f9e073d996","Type":"ContainerDied","Data":"3c39ef7ae1813d5a2497ec8c45b278a00dea42aebd20ab2c25de96e29cebd051"}
Oct 31 07:28:09.711877 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.711820    5039 scope.go:122] "RemoveContainer" containerID="3c39ef7ae1813d5a2497ec8c45b278a00dea42aebd20ab2c25de96e29cebd051"
Oct 31 07:28:09.713514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.713496    5039 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:28:09.713613 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.713539    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc" event={"ID":"5a3e7931-f6a9-419d-8cce-5c884e627036","Type":"ContainerStarted","Data":"fc6d4d7297936d072adc9348bec0697f9b8193432fc6cab543092d8c111cab05"}
Oct 31 07:28:09.713613 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.713579    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6ddb6c8b94-nl4vc" event={"ID":"5a3e7931-f6a9-419d-8cce-5c884e627036","Type":"ContainerStarted","Data":"19704e5e0f1056fe30a48cdb7699b0bee021e3537da1c03bc89854907a30b71f"}
Oct 31 07:28:09.727445 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:09.727419    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:10.112206 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.112167    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:10.376977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.376885    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:10.376977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.376962    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:10.377181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.376999    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:10.377181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.377023    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:10.377181 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:10.377032    5039 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Oct 31 07:28:10.377181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.377060    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:10.377181 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:10.377098    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls podName:e248978c-acdb-47f0-b702-c0029711230d nodeName:}" failed. No retries permitted until 2026-10-31 07:28:14.377079531 +0000 UTC m=+8.906274183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls") pod "dns-default-b4zz8" (UID: "e248978c-acdb-47f0-b702-c0029711230d") : secret "dns-default-metrics-tls" not found
Oct 31 07:28:10.377181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.377122    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:10.377771 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:10.377184    5039 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:10.377771 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:10.377235    5039 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:10.377771 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:10.377268    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls podName:078fdc95-76b1-4323-9985-905f939dbbc4 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:14.37725011 +0000 UTC m=+8.906444764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-884576c57-84prv" (UID: "078fdc95-76b1-4323-9985-905f939dbbc4") : secret "cluster-monitoring-operator-tls" not found
Oct 31 07:28:10.377771 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:10.377288    5039 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls podName:25eb80fc-fccc-4c7e-8e18-21d4afc76c55 nodeName:}" failed. No retries permitted until 2026-10-31 07:28:14.377278056 +0000 UTC m=+8.906472745 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls") pod "insights-runtime-extractor-98qs2" (UID: "25eb80fc-fccc-4c7e-8e18-21d4afc76c55") : secret "insights-runtime-extractor-tls" not found
Oct 31 07:28:10.379572 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.379547    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2a867c49-34bc-4114-8ee9-c3f30900d501-networking-console-plugin-cert\") pod \"networking-console-plugin-86c478bb88-pplb8\" (UID: \"2a867c49-34bc-4114-8ee9-c3f30900d501\") " pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:10.379677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.379550    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"image-registry-59b48874d4-s59mc\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") " pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:10.379677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.379634    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"image-registry-5cb764d49-7pjn2\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") " pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:10.522070 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.522025    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:10.522237 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.522087    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8"
Oct 31 07:28:10.528089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.528066    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:10.562229 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.562197    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:10.722993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.722946    5039 generic.go:356] "Generic (PLEG): container finished" podID="904b6555-9c6d-4489-9b17-0d96d5fe2c12" containerID="cf68cd0df0ce091fd335816a40d5a01b1db3b82ea0fb671ed1b621e6e18e1a38" exitCode=0
Oct 31 07:28:10.723447 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.722991    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6krlj" event={"ID":"904b6555-9c6d-4489-9b17-0d96d5fe2c12","Type":"ContainerDied","Data":"cf68cd0df0ce091fd335816a40d5a01b1db3b82ea0fb671ed1b621e6e18e1a38"}
Oct 31 07:28:10.723447 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.723381    5039 scope.go:122] "RemoveContainer" containerID="cf68cd0df0ce091fd335816a40d5a01b1db3b82ea0fb671ed1b621e6e18e1a38"
Oct 31 07:28:10.725078 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.725056    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7d4bc45dd6-dtncg" event={"ID":"71156071-2868-4bea-8ba9-20f9e073d996","Type":"ContainerStarted","Data":"ad31d4260b09f190193db181aecd51363c10840a1050988570958cd16bc2aba2"}
Oct 31 07:28:10.849174 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.849134    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-86c478bb88-pplb8"]
Oct 31 07:28:10.852421 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.852397    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5cb764d49-7pjn2"]
Oct 31 07:28:10.855785 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:10.855759    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a867c49_34bc_4114_8ee9_c3f30900d501.slice/crio-e97d6307f4c1f25b03abb5a6211d5f4644308657862684916bac9f8c4b418331 WatchSource:0}: Error finding container e97d6307f4c1f25b03abb5a6211d5f4644308657862684916bac9f8c4b418331: Status 404 returned error can't find the container with id e97d6307f4c1f25b03abb5a6211d5f4644308657862684916bac9f8c4b418331
Oct 31 07:28:10.858677 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:10.858651    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac9165f9_9d82_4cd4_b2ab_0cb2098c9ad6.slice/crio-509e6155c48cb1d15bf381005a08bd68355543d5cd5f6ad8dd16fc5dd413243f WatchSource:0}: Error finding container 509e6155c48cb1d15bf381005a08bd68355543d5cd5f6ad8dd16fc5dd413243f: Status 404 returned error can't find the container with id 509e6155c48cb1d15bf381005a08bd68355543d5cd5f6ad8dd16fc5dd413243f
Oct 31 07:28:10.867905 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.867871    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59b48874d4-s59mc"]
Oct 31 07:28:10.874875 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:10.874845    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f39613d_2e12_4ac7_a5d3_e6429b3b874f.slice/crio-df7d02eaed6bd9ecb5086eae580e85f3e88985edc35858c08329e713d25de478 WatchSource:0}: Error finding container df7d02eaed6bd9ecb5086eae580e85f3e88985edc35858c08329e713d25de478: Status 404 returned error can't find the container with id df7d02eaed6bd9ecb5086eae580e85f3e88985edc35858c08329e713d25de478
Oct 31 07:28:10.900957 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:10.900928    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:11.302679 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:11.302642    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:11.506613 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:11.506566    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:11.711135 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:11.711086    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:11.733182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:11.732599    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2" event={"ID":"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6","Type":"ContainerStarted","Data":"0b2118adbc8cb0ac17f90a6c0fefb5eece4fa5a37959a79282058f3eff3f6475"}
Oct 31 07:28:11.733182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:11.732663    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2" event={"ID":"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6","Type":"ContainerStarted","Data":"509e6155c48cb1d15bf381005a08bd68355543d5cd5f6ad8dd16fc5dd413243f"}
Oct 31 07:28:11.734771 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:11.734736    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b48874d4-s59mc" event={"ID":"9f39613d-2e12-4ac7-a5d3-e6429b3b874f","Type":"ContainerStarted","Data":"9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f"}
Oct 31 07:28:11.734906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:11.734782    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b48874d4-s59mc" event={"ID":"9f39613d-2e12-4ac7-a5d3-e6429b3b874f","Type":"ContainerStarted","Data":"df7d02eaed6bd9ecb5086eae580e85f3e88985edc35858c08329e713d25de478"}
Oct 31 07:28:11.736263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:11.736237    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8" event={"ID":"2a867c49-34bc-4114-8ee9-c3f30900d501","Type":"ContainerStarted","Data":"e97d6307f4c1f25b03abb5a6211d5f4644308657862684916bac9f8c4b418331"}
Oct 31 07:28:11.738177 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:11.738150    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6krlj" event={"ID":"904b6555-9c6d-4489-9b17-0d96d5fe2c12","Type":"ContainerStarted","Data":"7eb49197aefb559e41326de437a2f2891f73c2bb08a096a78808cc38e0d58176"}
Oct 31 07:28:12.103194 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:12.103159    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:12.670343 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:12.670309    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:12.742989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:12.742947    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-86c478bb88-pplb8" event={"ID":"2a867c49-34bc-4114-8ee9-c3f30900d501","Type":"ContainerStarted","Data":"a297411d257cc6b4c6a016ef25d6a203356e5aca1f7e7f5643b10ee9319f8f1d"}
Oct 31 07:28:12.742989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:12.742983    5039 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:28:12.743505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:12.743012    5039 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:28:12.906521 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:12.906491    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:12.930604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:12.930520    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:12.930732 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:12.930672    5039 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:28:12.932451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:12.932430    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-79b9f58c8f-wd2zk"
Oct 31 07:28:13.305808 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:13.305766    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:13.412098 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:13.412063    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:13.517436 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:13.517402    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:13.693145 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:13.693070    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:13.713237 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:13.713208    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:13.898718 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:13.898687    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:14.417471 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.417430    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:14.417662 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.417482    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:14.417662 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.417520    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:14.420055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.420025    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e248978c-acdb-47f0-b702-c0029711230d-metrics-tls\") pod \"dns-default-b4zz8\" (UID: \"e248978c-acdb-47f0-b702-c0029711230d\") " pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:14.420174 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.420060    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/078fdc95-76b1-4323-9985-905f939dbbc4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-884576c57-84prv\" (UID: \"078fdc95-76b1-4323-9985-905f939dbbc4\") " pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:14.420174 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.420025    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/25eb80fc-fccc-4c7e-8e18-21d4afc76c55-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-98qs2\" (UID: \"25eb80fc-fccc-4c7e-8e18-21d4afc76c55\") " pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:14.430004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.429973    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:14.432095 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.432074    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-98qs2"
Oct 31 07:28:14.717469 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.717433    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"
Oct 31 07:28:14.756187 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.756155    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b4zz8"]
Oct 31 07:28:14.761867 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:14.761839    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode248978c_acdb_47f0_b702_c0029711230d.slice/crio-46877a0fadafe17df4e21ed435c1a7567cf62b67139da41deab37c578307d276 WatchSource:0}: Error finding container 46877a0fadafe17df4e21ed435c1a7567cf62b67139da41deab37c578307d276: Status 404 returned error can't find the container with id 46877a0fadafe17df4e21ed435c1a7567cf62b67139da41deab37c578307d276
Oct 31 07:28:14.765963 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:14.765910    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25eb80fc_fccc_4c7e_8e18_21d4afc76c55.slice/crio-d988a950a2ddacba6a9f038eaa3c1bf6e103e2001d733b21aa61ef8caf56f528 WatchSource:0}: Error finding container d988a950a2ddacba6a9f038eaa3c1bf6e103e2001d733b21aa61ef8caf56f528: Status 404 returned error can't find the container with id d988a950a2ddacba6a9f038eaa3c1bf6e103e2001d733b21aa61ef8caf56f528
Oct 31 07:28:14.768813 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:14.768787    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-98qs2"]
Oct 31 07:28:15.014392 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:15.014305    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-884576c57-84prv"]
Oct 31 07:28:15.019772 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:15.019739    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078fdc95_76b1_4323_9985_905f939dbbc4.slice/crio-0f277813c4ad9294e9e1f2a36d6b52d7ce5ff2c930d7cc1f4b9d69c006c21f87 WatchSource:0}: Error finding container 0f277813c4ad9294e9e1f2a36d6b52d7ce5ff2c930d7cc1f4b9d69c006c21f87: Status 404 returned error can't find the container with id 0f277813c4ad9294e9e1f2a36d6b52d7ce5ff2c930d7cc1f4b9d69c006c21f87
Oct 31 07:28:15.756776 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:15.756730    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv" event={"ID":"078fdc95-76b1-4323-9985-905f939dbbc4","Type":"ContainerStarted","Data":"0f277813c4ad9294e9e1f2a36d6b52d7ce5ff2c930d7cc1f4b9d69c006c21f87"}
Oct 31 07:28:15.759061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:15.759024    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98qs2" event={"ID":"25eb80fc-fccc-4c7e-8e18-21d4afc76c55","Type":"ContainerStarted","Data":"7846cecfce3786758b88836bf0fa759045501852978542c21b57a895ed89a9e3"}
Oct 31 07:28:15.759230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:15.759080    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98qs2" event={"ID":"25eb80fc-fccc-4c7e-8e18-21d4afc76c55","Type":"ContainerStarted","Data":"46e2fa1a1ea8ba588046f722cc2bef39ae4b21e00dac1daf797d149255941cfd"}
Oct 31 07:28:15.759230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:15.759098    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98qs2" event={"ID":"25eb80fc-fccc-4c7e-8e18-21d4afc76c55","Type":"ContainerStarted","Data":"d988a950a2ddacba6a9f038eaa3c1bf6e103e2001d733b21aa61ef8caf56f528"}
Oct 31 07:28:15.760570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:15.760532    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4zz8" event={"ID":"e248978c-acdb-47f0-b702-c0029711230d","Type":"ContainerStarted","Data":"46877a0fadafe17df4e21ed435c1a7567cf62b67139da41deab37c578307d276"}
Oct 31 07:28:15.910468 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:15.910429    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:16.491383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:16.491032    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:16.491383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:16.491309    5039 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:28:16.768485 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:16.768372    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4zz8" event={"ID":"e248978c-acdb-47f0-b702-c0029711230d","Type":"ContainerStarted","Data":"63c1469e593d05682bca01012ab091183b3a3cc0208fa786039dd078ec7cb91d"}
Oct 31 07:28:17.442333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:17.442294    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:17.551069 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:17.551036    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:17.780405 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:17.780366    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-884576c57-84prv" event={"ID":"078fdc95-76b1-4323-9985-905f939dbbc4","Type":"ContainerStarted","Data":"523c03508ca0f2867f03fc1391d8aded908a6625c7baf2b52db8fa3ea9d7dd06"}
Oct 31 07:28:17.782970 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:17.782938    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-98qs2" event={"ID":"25eb80fc-fccc-4c7e-8e18-21d4afc76c55","Type":"ContainerStarted","Data":"a368ce4dc1f7ba300a8039deb274c0a0dec515efe5d1fc01eac179d89e491f7c"}
Oct 31 07:28:17.784651 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:17.784622    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b4zz8" event={"ID":"e248978c-acdb-47f0-b702-c0029711230d","Type":"ContainerStarted","Data":"cada7356e62e463e8315213836ddd8600fbcb8277d1de5ac62b85a6f2c15bbb6"}
Oct 31 07:28:17.784782 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:17.784764    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:17.841284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:17.841246    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:17.946932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:17.946891    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:19.785380 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:19.785346    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:19.890493 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:19.890463    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:23.994106 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:23.994065    5039 patch_prober.go:29] interesting pod/image-registry-5cb764d49-7pjn2 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 31 07:28:23.994580 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:23.994125    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2" podUID="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:28:24.764138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:24.764105    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb764d49-7pjn2"]
Oct 31 07:28:24.820422 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:24.820378    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:24.957534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:24.957497    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:25.086967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:25.086856    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:25.487260 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:25.487229    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kqq5l"
Oct 31 07:28:26.993606 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:26.993576    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kwmnp"
Oct 31 07:28:27.791788 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:27.791752    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b4zz8"
Oct 31 07:28:27.945809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:27.945776    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:28.063350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:28.063277    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:28.182258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:28.182224    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:28.695358 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:28.695321    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:28:30.105572 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:30.105541    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:30.316208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:30.316172    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:30.424968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:30.424864    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:31.063866 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:31.063821    5039 patch_prober.go:29] interesting pod/image-registry-59b48874d4-s59mc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Oct 31 07:28:31.064062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:31.063891    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59b48874d4-s59mc" podUID="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:28:31.360179 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:31.360099    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:32.433466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:32.433420    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:32.538008 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:32.537973    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:32.700990 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:32.700884    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:32.806326 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:32.806287    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:33.352699 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.352655    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:33.463242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.463208    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:33.596080 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.596045    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:33.657552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.657448    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-hfsww"]
Oct 31 07:28:33.703303 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.703266    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.713965 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.713935    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:33.750897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.750865    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:28:33.791859 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.791819    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-textfile\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.791859 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.791862    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-root\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.792142 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.791884    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-tls\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.792142 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.792009    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-wtmp\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.792250 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.792210    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-metrics-client-ca\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.792308 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.792251    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-accelerators-collector-config\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.792408 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.792382    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzsm8\" (UniqueName: \"kubernetes.io/projected/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-kube-api-access-jzsm8\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.792597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.792574    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.792725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.792700    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-sys\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.819029 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.818985    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 07:28:33.819029 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.818985    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 07:28:33.819029 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.818989    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 07:28:33.819328 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.819062    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ppvgk\""
Oct 31 07:28:33.819328 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.819109    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 07:28:33.833910 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.833875    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:33.894582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894546    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.894765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894605    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-sys\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.894765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894646    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-textfile\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.894765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894694    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-root\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.894765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894720    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-tls\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.894765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894730    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-sys\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.894765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894754    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-wtmp\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.895083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894806    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-metrics-client-ca\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.895083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894854    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-accelerators-collector-config\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.895083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894884    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzsm8\" (UniqueName: \"kubernetes.io/projected/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-kube-api-access-jzsm8\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.895083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.894892    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-wtmp\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.895083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.895049    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-root\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.895322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.895263    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-textfile\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.895756 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.895732    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-accelerators-collector-config\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.895861 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.895795    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-metrics-client-ca\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.897212 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.897193    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.897668 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.897650    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-node-exporter-tls\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.912742 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.912687    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzsm8\" (UniqueName: \"kubernetes.io/projected/4f90b6fc-a211-44aa-b021-f2dab5fcdf22-kube-api-access-jzsm8\") pod \"node-exporter-hfsww\" (UID: \"4f90b6fc-a211-44aa-b021-f2dab5fcdf22\") " pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:33.963898 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:33.963865    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:34.055672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:34.055636    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-hfsww"
Oct 31 07:28:34.075687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:34.075652    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:34.096580 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:28:34.096554    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f90b6fc_a211_44aa_b021_f2dab5fcdf22.slice/crio-b159022dd4f4f297a2d6362ec2053c31dc65979bfea58c5a5e0627f7f31a3e87 WatchSource:0}: Error finding container b159022dd4f4f297a2d6362ec2053c31dc65979bfea58c5a5e0627f7f31a3e87: Status 404 returned error can't find the container with id b159022dd4f4f297a2d6362ec2053c31dc65979bfea58c5a5e0627f7f31a3e87
Oct 31 07:28:34.336525 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:34.336485    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:34.450787 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:34.450753    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:34.772201 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:34.771974    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:34.777409 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:34.777376    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:34.863066 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:34.863027    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfsww" event={"ID":"4f90b6fc-a211-44aa-b021-f2dab5fcdf22","Type":"ContainerStarted","Data":"b159022dd4f4f297a2d6362ec2053c31dc65979bfea58c5a5e0627f7f31a3e87"}
Oct 31 07:28:34.892553 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:34.892522    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:35.001222 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:35.001171    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:35.128935 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:35.128829    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:35.868302 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:35.868203    5039 generic.go:356] "Generic (PLEG): container finished" podID="4f90b6fc-a211-44aa-b021-f2dab5fcdf22" containerID="633f7d3a9701dbc616ecce4daafc23c48d93888e23b8b3d47f1c98a43e18dbe0" exitCode=0
Oct 31 07:28:35.868770 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:35.868285    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfsww" event={"ID":"4f90b6fc-a211-44aa-b021-f2dab5fcdf22","Type":"ContainerDied","Data":"633f7d3a9701dbc616ecce4daafc23c48d93888e23b8b3d47f1c98a43e18dbe0"}
Oct 31 07:28:36.876402 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:36.876356    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfsww" event={"ID":"4f90b6fc-a211-44aa-b021-f2dab5fcdf22","Type":"ContainerStarted","Data":"1c955f673384885859f570bcabe3997eddecea0162b62d3fbe4c11e6d53fed91"}
Oct 31 07:28:36.876874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:36.876412    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-hfsww" event={"ID":"4f90b6fc-a211-44aa-b021-f2dab5fcdf22","Type":"ContainerStarted","Data":"1f3b9ea516ac3273e388ed26af21c70d5ed9698172cabb29fef733d5893c63f9"}
Oct 31 07:28:36.916874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:36.916812    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-hfsww" podStartSLOduration=2.431628532 podStartE2EDuration="3.91679312s" totalImagesPullingTime="1.396373357s" totalInitContainerRuntime="88.791231ms" isStatefulPod=true podCreationTimestamp="2026-10-31 07:28:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:28:36.91533259 +0000 UTC m=+31.444527266" watchObservedRunningTime="2026-10-31 07:28:36.91679312 +0000 UTC m=+31.445987788"
Oct 31 07:28:36.946927 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:36.946880    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:37.093925 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:37.093880    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:37.304466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:37.304412    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:38.468394 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:38.468360    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:38.676587 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:38.676555    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:38.880200 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:38.880126    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:39.364088 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:39.364052    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mtrsf"
Oct 31 07:28:40.654542 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:40.654505    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:42.163659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:42.163626    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:42.280252 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:42.280216    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:42.617136 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:42.617096    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:42.723075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:42.723040    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:48.684243 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:48.684153    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59b48874d4-s59mc"]
Oct 31 07:28:48.799820 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:48.799774    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:48.914158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:48.914116    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:49.030856 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:49.030820    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:49.710690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:49.710658    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:49.788347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:49.788310    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2" podUID="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" containerName="registry" containerID="cri-o://0b2118adbc8cb0ac17f90a6c0fefb5eece4fa5a37959a79282058f3eff3f6475" gracePeriod=30
Oct 31 07:28:49.813483 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:49.813450    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:49.930348 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:49.930314    5039 generic.go:356] "Generic (PLEG): container finished" podID="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" containerID="0b2118adbc8cb0ac17f90a6c0fefb5eece4fa5a37959a79282058f3eff3f6475" exitCode=0
Oct 31 07:28:49.930485 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:49.930383    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2" event={"ID":"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6","Type":"ContainerDied","Data":"0b2118adbc8cb0ac17f90a6c0fefb5eece4fa5a37959a79282058f3eff3f6475"}
Oct 31 07:28:50.053786 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.053751    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:50.149711 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.149675    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration\") pod \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") "
Oct 31 07:28:50.149711 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.149719    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates\") pod \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") "
Oct 31 07:28:50.150013 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.149756    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca\") pod \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") "
Oct 31 07:28:50.150013 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.149782    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted\") pod \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") "
Oct 31 07:28:50.150013 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.149967    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets\") pod \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") "
Oct 31 07:28:50.150181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.150027    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") pod \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") "
Oct 31 07:28:50.150181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.150062    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md\") pod \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") "
Oct 31 07:28:50.150181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.150100    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token\") pod \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\" (UID: \"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6\") "
Oct 31 07:28:50.150377 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.150330    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates" pod "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:28:50.150472 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.150380    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca" pod "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:28:50.150628 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.150604    5039 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-certificates\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:28:50.150703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.150635    5039 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-trusted-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:28:50.152733 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.152697    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md" pod "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6"). InnerVolumeSpecName "kube-api-access-t96md". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:28:50.152865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.152697    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets" pod "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:28:50.152947 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.152898    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls" pod "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:28:50.153032 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.153006    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration" pod "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:28:50.156361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.156339    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token" pod "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:28:50.157297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.157276    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted" pod "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" (UID: "ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:28:50.251211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.251118    5039 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-image-registry-private-configuration\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:28:50.251211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.251153    5039 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-ca-trust-extracted\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:28:50.251211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.251164    5039 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-installation-pull-secrets\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:28:50.251211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.251176    5039 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-registry-tls\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:28:50.251211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.251185    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t96md\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-kube-api-access-t96md\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:28:50.251211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.251195    5039 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6-bound-sa-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:28:50.494248 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.494202    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:50.594119 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.594044    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:50.935885 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.935802    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2"
Oct 31 07:28:50.935885 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.935819    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5cb764d49-7pjn2" event={"ID":"ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6","Type":"ContainerDied","Data":"509e6155c48cb1d15bf381005a08bd68355543d5cd5f6ad8dd16fc5dd413243f"}
Oct 31 07:28:50.935885 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.935873    5039 scope.go:122] "RemoveContainer" containerID="0b2118adbc8cb0ac17f90a6c0fefb5eece4fa5a37959a79282058f3eff3f6475"
Oct 31 07:28:50.998680 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:50.998644    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5cb764d49-7pjn2"]
Oct 31 07:28:51.010064 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:51.010030    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5cb764d49-7pjn2"]
Oct 31 07:28:51.613561 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:51.613523    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" path="/var/lib/kubelet/pods/ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6/volumes"
Oct 31 07:28:53.367673 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:53.367640    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:53.483279 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:53.483244    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:55.071123 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:55.071088    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:55.204097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:55.204065    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:57.781452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:57.781417    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:57.887829 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:57.887787    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:57.998221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:28:57.998175    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:28:58.695954 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:28:58.695897    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:29:04.773449 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:04.773407    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:04.877884 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:04.877846    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:12.024571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:12.024535    5039 generic.go:356] "Generic (PLEG): container finished" podID="904b6555-9c6d-4489-9b17-0d96d5fe2c12" containerID="7eb49197aefb559e41326de437a2f2891f73c2bb08a096a78808cc38e0d58176" exitCode=0
Oct 31 07:29:12.025068 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:12.024594    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6krlj" event={"ID":"904b6555-9c6d-4489-9b17-0d96d5fe2c12","Type":"ContainerDied","Data":"7eb49197aefb559e41326de437a2f2891f73c2bb08a096a78808cc38e0d58176"}
Oct 31 07:29:12.025068 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:12.024638    5039 scope.go:122] "RemoveContainer" containerID="cf68cd0df0ce091fd335816a40d5a01b1db3b82ea0fb671ed1b621e6e18e1a38"
Oct 31 07:29:12.025068 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:12.024987    5039 scope.go:122] "RemoveContainer" containerID="7eb49197aefb559e41326de437a2f2891f73c2bb08a096a78808cc38e0d58176"
Oct 31 07:29:12.025233 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:29:12.025212    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"insights-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=insights-operator pod=insights-operator-7c4986d449-6krlj_openshift-insights(904b6555-9c6d-4489-9b17-0d96d5fe2c12)\"" pod="openshift-insights/insights-operator-7c4986d449-6krlj" podUID="904b6555-9c6d-4489-9b17-0d96d5fe2c12"
Oct 31 07:29:13.707994 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:13.707951    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59b48874d4-s59mc" podUID="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" containerName="registry" containerID="cri-o://9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f" gracePeriod=30
Oct 31 07:29:13.747757 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:13.747719    5039 patch_prober.go:29] interesting pod/image-registry-59b48874d4-s59mc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="Get \"https://10.132.0.22:5000/healthz\": dial tcp 10.132.0.22:5000: connect: connection refused" start-of-body=
Oct 31 07:29:13.747887 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:13.747797    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59b48874d4-s59mc" podUID="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" containerName="registry" probeResult="failure" output="Get \"https://10.132.0.22:5000/healthz\": dial tcp 10.132.0.22:5000: connect: connection refused"
Oct 31 07:29:13.953328 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:13.953302    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:29:14.035881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.035790    5039 generic.go:356] "Generic (PLEG): container finished" podID="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" containerID="9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f" exitCode=0
Oct 31 07:29:14.035881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.035851    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b48874d4-s59mc"
Oct 31 07:29:14.036150 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.035857    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b48874d4-s59mc" event={"ID":"9f39613d-2e12-4ac7-a5d3-e6429b3b874f","Type":"ContainerDied","Data":"9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f"}
Oct 31 07:29:14.036150 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.035979    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b48874d4-s59mc" event={"ID":"9f39613d-2e12-4ac7-a5d3-e6429b3b874f","Type":"ContainerDied","Data":"df7d02eaed6bd9ecb5086eae580e85f3e88985edc35858c08329e713d25de478"}
Oct 31 07:29:14.036150 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.036018    5039 scope.go:122] "RemoveContainer" containerID="9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f"
Oct 31 07:29:14.045005 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.044982    5039 scope.go:122] "RemoveContainer" containerID="9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f"
Oct 31 07:29:14.045317 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:29:14.045292    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f\": container with ID starting with 9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f not found: ID does not exist" containerID="9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f"
Oct 31 07:29:14.045416 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.045324    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f"} err="failed to get container status \"9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f\": rpc error: code = NotFound desc = could not find container \"9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f\": container with ID starting with 9ed81267cbcc81a2532d8171cc8cd9e443a4d78f218e2168e73c915cfe0eeb8f not found: ID does not exist"
Oct 31 07:29:14.049623 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.049603    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted\") pod \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") "
Oct 31 07:29:14.049743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.049692    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates\") pod \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") "
Oct 31 07:29:14.049743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.049726    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") pod \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") "
Oct 31 07:29:14.049901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.049765    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca\") pod \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") "
Oct 31 07:29:14.049901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.049815    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets\") pod \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") "
Oct 31 07:29:14.049901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.049866    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55\") pod \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") "
Oct 31 07:29:14.050065 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.049909    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token\") pod \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") "
Oct 31 07:29:14.050065 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.049996    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration\") pod \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\" (UID: \"9f39613d-2e12-4ac7-a5d3-e6429b3b874f\") "
Oct 31 07:29:14.050211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.050184    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates" pod "9f39613d-2e12-4ac7-a5d3-e6429b3b874f" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:29:14.050414 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.050359    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca" pod "9f39613d-2e12-4ac7-a5d3-e6429b3b874f" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:29:14.052438 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.052393    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets" pod "9f39613d-2e12-4ac7-a5d3-e6429b3b874f" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:29:14.052546 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.052439    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55" pod "9f39613d-2e12-4ac7-a5d3-e6429b3b874f" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f"). InnerVolumeSpecName "kube-api-access-t2v55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:29:14.052744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.052716    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls" pod "9f39613d-2e12-4ac7-a5d3-e6429b3b874f" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:29:14.052744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.052715    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration" pod "9f39613d-2e12-4ac7-a5d3-e6429b3b874f" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:29:14.052901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.052877    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token" pod "9f39613d-2e12-4ac7-a5d3-e6429b3b874f" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:29:14.057390 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.057276    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted" pod "9f39613d-2e12-4ac7-a5d3-e6429b3b874f" (UID: "9f39613d-2e12-4ac7-a5d3-e6429b3b874f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:29:14.151133 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.151086    5039 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-trusted-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:14.151133 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.151132    5039 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-installation-pull-secrets\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:14.151133 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.151143    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2v55\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-kube-api-access-t2v55\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:14.151369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.151153    5039 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-bound-sa-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:14.151369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.151163    5039 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-image-registry-private-configuration\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:14.151369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.151173    5039 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-ca-trust-extracted\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:14.151369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.151181    5039 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-certificates\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:14.151369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.151190    5039 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f39613d-2e12-4ac7-a5d3-e6429b3b874f-registry-tls\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:14.377965 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.377910    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59b48874d4-s59mc"]
Oct 31 07:29:14.389742 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:14.389703    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59b48874d4-s59mc"]
Oct 31 07:29:15.612744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:15.612701    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" path="/var/lib/kubelet/pods/9f39613d-2e12-4ac7-a5d3-e6429b3b874f/volumes"
Oct 31 07:29:16.046202 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:16.046165    5039 generic.go:356] "Generic (PLEG): container finished" podID="6b351b59-c90b-42cb-87b1-228f83da0488" containerID="ec411200fc2da5f92aad77ad61a5965f5ee86f52e23477f0299b2b5d349b06b2" exitCode=0
Oct 31 07:29:16.046377 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:16.046236    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9" event={"ID":"6b351b59-c90b-42cb-87b1-228f83da0488","Type":"ContainerDied","Data":"ec411200fc2da5f92aad77ad61a5965f5ee86f52e23477f0299b2b5d349b06b2"}
Oct 31 07:29:16.046588 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:16.046571    5039 scope.go:122] "RemoveContainer" containerID="ec411200fc2da5f92aad77ad61a5965f5ee86f52e23477f0299b2b5d349b06b2"
Oct 31 07:29:17.051361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:17.051319    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-544d749c8c-mbxx9" event={"ID":"6b351b59-c90b-42cb-87b1-228f83da0488","Type":"ContainerStarted","Data":"a8cfaff3c8e45d3a2b2bb96ee2211d95a62e889ec915d66115d391238c10e246"}
Oct 31 07:29:19.774732 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:19.774693    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:19.881061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:19.881026    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:22.608884 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:22.608839    5039 scope.go:122] "RemoveContainer" containerID="7eb49197aefb559e41326de437a2f2891f73c2bb08a096a78808cc38e0d58176"
Oct 31 07:29:22.939832 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:22.939748    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:23.076812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.076775    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-7c4986d449-6krlj" event={"ID":"904b6555-9c6d-4489-9b17-0d96d5fe2c12","Type":"ContainerStarted","Data":"2e3ca5e7a802c8d3c19a98e48b70375fa90190672aa046f019598b43047842f5"}
Oct 31 07:29:23.214815 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.214777    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-t6jrq-6cxmm"]
Oct 31 07:29:23.215002 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.214984    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm" podUID="ad965044-2fab-47cf-935d-47121860352c" containerName="insights-gathering" containerID="cri-o://b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb" gracePeriod=30
Oct 31 07:29:23.219669 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.219631    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:23.463294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.463267    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:29:23.529619 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.529535    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle\") pod \"ad965044-2fab-47cf-935d-47121860352c\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") "
Oct 31 07:29:23.529619 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.529602    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle\") pod \"ad965044-2fab-47cf-935d-47121860352c\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") "
Oct 31 07:29:23.529809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.529668    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7\" (UniqueName: \"kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7\") pod \"ad965044-2fab-47cf-935d-47121860352c\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") "
Oct 31 07:29:23.529809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.529730    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path\") pod \"ad965044-2fab-47cf-935d-47121860352c\" (UID: \"ad965044-2fab-47cf-935d-47121860352c\") "
Oct 31 07:29:23.530074 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.530048    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle" pod "ad965044-2fab-47cf-935d-47121860352c" (UID: "ad965044-2fab-47cf-935d-47121860352c"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:29:23.530196 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.530088    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle" pod "ad965044-2fab-47cf-935d-47121860352c" (UID: "ad965044-2fab-47cf-935d-47121860352c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:29:23.530196 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.530110    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path" pod "ad965044-2fab-47cf-935d-47121860352c" (UID: "ad965044-2fab-47cf-935d-47121860352c"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:29:23.532046 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.532017    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7" pod "ad965044-2fab-47cf-935d-47121860352c" (UID: "ad965044-2fab-47cf-935d-47121860352c"). InnerVolumeSpecName "kube-api-access-h9kb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:29:23.630934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.630888    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9kb7\" (UniqueName: \"kubernetes.io/projected/ad965044-2fab-47cf-935d-47121860352c-kube-api-access-h9kb7\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:23.631310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.630940    5039 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ad965044-2fab-47cf-935d-47121860352c-archives-path\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:23.631310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.630952    5039 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-service-ca-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:23.631310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:23.630960    5039 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad965044-2fab-47cf-935d-47121860352c-trusted-ca-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:29:24.082186 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:24.082142    5039 generic.go:356] "Generic (PLEG): container finished" podID="ad965044-2fab-47cf-935d-47121860352c" containerID="b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb" exitCode=2
Oct 31 07:29:24.082387 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:24.082192    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm"
Oct 31 07:29:24.082387 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:24.082231    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm" event={"ID":"ad965044-2fab-47cf-935d-47121860352c","Type":"ContainerDied","Data":"b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb"}
Oct 31 07:29:24.082387 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:24.082294    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-t6jrq-6cxmm" event={"ID":"ad965044-2fab-47cf-935d-47121860352c","Type":"ContainerDied","Data":"f590b572ae403562acb55a707e1a8580bd38d13a42ca3387f5238b7046b6498f"}
Oct 31 07:29:24.082387 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:24.082321    5039 scope.go:122] "RemoveContainer" containerID="b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb"
Oct 31 07:29:24.092840 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:24.092811    5039 scope.go:122] "RemoveContainer" containerID="b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb"
Oct 31 07:29:24.093202 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:29:24.093181    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb\": container with ID starting with b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb not found: ID does not exist" containerID="b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb"
Oct 31 07:29:24.093271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:24.093214    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb"} err="failed to get container status \"b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb\": rpc error: code = NotFound desc = could not find container \"b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb\": container with ID starting with b945f2833398cccf0d3ef10d595fdd9913be2227cac562dde924a45be9f90bdb not found: ID does not exist"
Oct 31 07:29:24.129572 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:24.129529    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-t6jrq-6cxmm"]
Oct 31 07:29:24.141417 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:24.141386    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-t6jrq-6cxmm"]
Oct 31 07:29:25.617370 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:25.617339    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad965044-2fab-47cf-935d-47121860352c" path="/var/lib/kubelet/pods/ad965044-2fab-47cf-935d-47121860352c/volumes"
Oct 31 07:29:28.695723 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:29:28.695685    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:29:31.562045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:31.562009    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:31.854263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:31.854170    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:31.962533 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:31.962495    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:38.793846 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:38.793806    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:38.896893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:38.896861    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:42.216276 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:42.216236    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:42.332773 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:42.332733    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:42.633840 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:42.633755    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:42.736246 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:42.736210    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:43.309363 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:43.309327    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:51.420817 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:51.420785    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:51.533294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:51.533262    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:55.195238 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:29:55.195203    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:29:58.696399 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:29:58.696360    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:30:04.772000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:30:04.771951    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:30:04.884589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:30:04.884546    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:30:28.694957 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:30:28.694858    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:30:55.328968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:30:55.328907    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:30:58.694820 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:30:58.694781    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:31:05.309960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:31:05.309906    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:31:28.695442 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:31:28.695401    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:31:55.534052 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:31:55.533952    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:31:58.695550 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:31:58.695504    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:32:05.379110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:05.379059    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:18.783798 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:18.783766    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:18.961388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:18.961346    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:19.108120 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:19.108037    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:20.184758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.184720    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:20.300450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.300409    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:20.650334 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650300    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"]
Oct 31 07:32:20.650620 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650607    5039 cpu_manager.go:414] "containerMap: removing container" podUID="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" containerName="registry"
Oct 31 07:32:20.650664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650622    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" containerName="registry"
Oct 31 07:32:20.650664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650636    5039 cpu_manager.go:414] "containerMap: removing container" podUID="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" containerName="registry"
Oct 31 07:32:20.650664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650640    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" containerName="registry"
Oct 31 07:32:20.650664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650659    5039 cpu_manager.go:414] "containerMap: removing container" podUID="ad965044-2fab-47cf-935d-47121860352c" containerName="insights-gathering"
Oct 31 07:32:20.650664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650664    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad965044-2fab-47cf-935d-47121860352c" containerName="insights-gathering"
Oct 31 07:32:20.650809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650715    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="ac9165f9-9d82-4cd4-b2ab-0cb2098c9ad6" containerName="registry"
Oct 31 07:32:20.650809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650723    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="9f39613d-2e12-4ac7-a5d3-e6429b3b874f" containerName="registry"
Oct 31 07:32:20.650809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.650732    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad965044-2fab-47cf-935d-47121860352c" containerName="insights-gathering"
Oct 31 07:32:20.654172 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.654149    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.669664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.669630    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-5gvld\""
Oct 31 07:32:20.681800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.681773    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 07:32:20.681983 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.681814    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 07:32:20.683014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.682995    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"]
Oct 31 07:32:20.747555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.747513    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"]
Oct 31 07:32:20.751264 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.751238    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:20.760184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.760146    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.760423 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.760394    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.760487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.760468    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n557\" (UniqueName: \"kubernetes.io/projected/2f732eef-6b57-4a35-92e4-d3e32394255f-kube-api-access-6n557\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.770830 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.770796    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-4sdts\""
Oct 31 07:32:20.772132 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.772104    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"]
Oct 31 07:32:20.849382 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.849349    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"]
Oct 31 07:32:20.853245 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.853217    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:20.861693 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.861664    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:20.861927 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.861714    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.861927 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.861826    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmkvl\" (UniqueName: \"kubernetes.io/projected/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-kube-api-access-xmkvl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:20.861927 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.861859    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:20.861927 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.861882    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.862167 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.862000    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n557\" (UniqueName: \"kubernetes.io/projected/2f732eef-6b57-4a35-92e4-d3e32394255f-kube-api-access-6n557\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.862222 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.862169    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.862275 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.862253    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.867230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.867207    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-6qjzb\""
Oct 31 07:32:20.871977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.871950    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"]
Oct 31 07:32:20.881013 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.880983    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n557\" (UniqueName: \"kubernetes.io/projected/2f732eef-6b57-4a35-92e4-d3e32394255f-kube-api-access-6n557\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.948652 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.948563    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"]
Oct 31 07:32:20.952368 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.952342    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:20.962431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.962404    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxkdq\" (UniqueName: \"kubernetes.io/projected/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-kube-api-access-sxkdq\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:20.962570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.962451    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:20.962570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.962557    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmkvl\" (UniqueName: \"kubernetes.io/projected/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-kube-api-access-xmkvl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:20.962662 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.962600    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:20.962662 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.962644    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:20.962748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.962703    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:20.962865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.962847    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:20.962952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.962893    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:20.966588 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.966569    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-srx6k\""
Oct 31 07:32:20.969624 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.969607    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:32:20.971047 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.971028    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"]
Oct 31 07:32:20.982688 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:20.982659    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmkvl\" (UniqueName: \"kubernetes.io/projected/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-kube-api-access-xmkvl\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:21.063637 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.063604    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:21.063796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.063644    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxkdq\" (UniqueName: \"kubernetes.io/projected/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-kube-api-access-sxkdq\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:21.063796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.063687    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25mcm\" (UniqueName: \"kubernetes.io/projected/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-kube-api-access-25mcm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.063796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.063712    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.063796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.063734    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.064107 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.063830    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:21.064107 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.064016    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:21.064211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.064193    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:21.071572 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.071545    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:21.084630 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.084604    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxkdq\" (UniqueName: \"kubernetes.io/projected/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-kube-api-access-sxkdq\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:21.093195 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.093161    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:21.164441 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.164406    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25mcm\" (UniqueName: \"kubernetes.io/projected/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-kube-api-access-25mcm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.164441 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.164445    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.164665 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.164464    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.164806 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.164787    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.164860 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.164845    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.169309 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.169292    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:21.183104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.183081    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25mcm\" (UniqueName: \"kubernetes.io/projected/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-kube-api-access-25mcm\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.268559 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.268518    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:32:21.273652 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.273536    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"]
Oct 31 07:32:21.280128 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:32:21.280089    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f732eef_6b57_4a35_92e4_d3e32394255f.slice/crio-74763bb6225a2b2d30445c39b029d8b21c5c65584d4f0b83fc06e19f131bab9d WatchSource:0}: Error finding container 74763bb6225a2b2d30445c39b029d8b21c5c65584d4f0b83fc06e19f131bab9d: Status 404 returned error can't find the container with id 74763bb6225a2b2d30445c39b029d8b21c5c65584d4f0b83fc06e19f131bab9d
Oct 31 07:32:21.369217 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.369172    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"]
Oct 31 07:32:21.374041 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:32:21.374006    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08e8dfa3_2243_41b2_8c47_8c61b1e8d5bf.slice/crio-91756b62a0b6e10117fb803566d2fbaaabb6fd0caca83fa7e01c0fef630afef5 WatchSource:0}: Error finding container 91756b62a0b6e10117fb803566d2fbaaabb6fd0caca83fa7e01c0fef630afef5: Status 404 returned error can't find the container with id 91756b62a0b6e10117fb803566d2fbaaabb6fd0caca83fa7e01c0fef630afef5
Oct 31 07:32:21.382322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.382296    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"]
Oct 31 07:32:21.387244 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.387220    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.402849 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.402822    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-hvs2c\""
Oct 31 07:32:21.403272 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.403252    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"]
Oct 31 07:32:21.462949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.462902    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"]
Oct 31 07:32:21.467512 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:32:21.467454    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa0b826_c7ad_45d0_876c_dfa7f9daf74b.slice/crio-b08cb72c4bec564ede260b7a8b6645f682e65c9852022def2122ebfa3fb963c3 WatchSource:0}: Error finding container b08cb72c4bec564ede260b7a8b6645f682e65c9852022def2122ebfa3fb963c3: Status 404 returned error can't find the container with id b08cb72c4bec564ede260b7a8b6645f682e65c9852022def2122ebfa3fb963c3
Oct 31 07:32:21.565135 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.565096    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"]
Oct 31 07:32:21.568329 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.568305    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cskf\" (UniqueName: \"kubernetes.io/projected/0ef46937-30de-4820-b2e6-53fd09e92ad3-kube-api-access-7cskf\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.568384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.568349    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.568505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.568480    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.570201 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:32:21.570178    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb396ea27_9d30_4c1b_a1e1_e680d2b2d660.slice/crio-b0a368c0b04b8847d7d991561aa5e2cf0a022e4ae4517c73b8c881047620a46f WatchSource:0}: Error finding container b0a368c0b04b8847d7d991561aa5e2cf0a022e4ae4517c73b8c881047620a46f: Status 404 returned error can't find the container with id b0a368c0b04b8847d7d991561aa5e2cf0a022e4ae4517c73b8c881047620a46f
Oct 31 07:32:21.669271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.669231    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.669426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.669287    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cskf\" (UniqueName: \"kubernetes.io/projected/0ef46937-30de-4820-b2e6-53fd09e92ad3-kube-api-access-7cskf\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.669426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.669323    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.669652 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.669627    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.669692 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.669661    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.688585 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.688548    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cskf\" (UniqueName: \"kubernetes.io/projected/0ef46937-30de-4820-b2e6-53fd09e92ad3-kube-api-access-7cskf\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.704284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.704240    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:32:21.783428 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.783385    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx" event={"ID":"b396ea27-9d30-4c1b-a1e1-e680d2b2d660","Type":"ContainerStarted","Data":"b0a368c0b04b8847d7d991561aa5e2cf0a022e4ae4517c73b8c881047620a46f"}
Oct 31 07:32:21.785146 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.785110    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm" event={"ID":"2f732eef-6b57-4a35-92e4-d3e32394255f","Type":"ContainerStarted","Data":"74763bb6225a2b2d30445c39b029d8b21c5c65584d4f0b83fc06e19f131bab9d"}
Oct 31 07:32:21.786769 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.786721    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s" event={"ID":"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf","Type":"ContainerStarted","Data":"91756b62a0b6e10117fb803566d2fbaaabb6fd0caca83fa7e01c0fef630afef5"}
Oct 31 07:32:21.788738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:21.788709    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd" event={"ID":"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b","Type":"ContainerStarted","Data":"b08cb72c4bec564ede260b7a8b6645f682e65c9852022def2122ebfa3fb963c3"}
Oct 31 07:32:22.015537 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:22.015497    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"]
Oct 31 07:32:22.023607 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:32:22.023249    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ef46937_30de_4820_b2e6_53fd09e92ad3.slice/crio-170fbd40ff5f4d4f062f89a70124fefd0d316b23ae8d32b5fb4ea9871c620943 WatchSource:0}: Error finding container 170fbd40ff5f4d4f062f89a70124fefd0d316b23ae8d32b5fb4ea9871c620943: Status 404 returned error can't find the container with id 170fbd40ff5f4d4f062f89a70124fefd0d316b23ae8d32b5fb4ea9871c620943
Oct 31 07:32:22.590082 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:22.590012    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:22.696575 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:22.696538    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:22.801898 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:22.801814    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z" event={"ID":"0ef46937-30de-4820-b2e6-53fd09e92ad3","Type":"ContainerStarted","Data":"170fbd40ff5f4d4f062f89a70124fefd0d316b23ae8d32b5fb4ea9871c620943"}
Oct 31 07:32:23.043579 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.043536    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"]
Oct 31 07:32:23.047808 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.047781    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.076085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.076052    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-95zq9\""
Oct 31 07:32:23.077645 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.077618    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"]
Oct 31 07:32:23.185262 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.185221    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.185420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.185306    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztmj9\" (UniqueName: \"kubernetes.io/projected/d47f13b7-997a-4707-8ed3-288a15508dad-kube-api-access-ztmj9\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.185420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.185346    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.286507 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.286465    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.286712 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.286539    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.286712 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.286609    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztmj9\" (UniqueName: \"kubernetes.io/projected/d47f13b7-997a-4707-8ed3-288a15508dad-kube-api-access-ztmj9\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.287420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.287390    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.287682 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.287658    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.320140 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.320057    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztmj9\" (UniqueName: \"kubernetes.io/projected/d47f13b7-997a-4707-8ed3-288a15508dad-kube-api-access-ztmj9\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.372668 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.372627    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:32:23.731979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.727071    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"]
Oct 31 07:32:23.744959 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:32:23.742045    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47f13b7_997a_4707_8ed3_288a15508dad.slice/crio-d537863320b4295c60e8742a4e33792d711016b689a5b2c84470569e1bcead44 WatchSource:0}: Error finding container d537863320b4295c60e8742a4e33792d711016b689a5b2c84470569e1bcead44: Status 404 returned error can't find the container with id d537863320b4295c60e8742a4e33792d711016b689a5b2c84470569e1bcead44
Oct 31 07:32:23.812378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:23.812334    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2" event={"ID":"d47f13b7-997a-4707-8ed3-288a15508dad","Type":"ContainerStarted","Data":"d537863320b4295c60e8742a4e33792d711016b689a5b2c84470569e1bcead44"}
Oct 31 07:32:24.489069 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:24.488970    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:24.601731 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:24.601657    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:25.152490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.150640    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"]
Oct 31 07:32:25.155534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.154855    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.181417 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.177871    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 31 07:32:25.188219 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.188186    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"]
Oct 31 07:32:25.204120 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.204069    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.204417 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.204385    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.204559 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.204542    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.204676 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.204662    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.204804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.204788    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7942b45d-8533-4089-a961-751c59ba0591-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.205066 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.205048    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.205242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.205217    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76nzh\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-kube-api-access-76nzh\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.205424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.205391    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7942b45d-8533-4089-a961-751c59ba0591-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.205575 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.205558    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.227581 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.227538    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:25.229283 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.229257    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-m48c6\""
Oct 31 07:32:25.285876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.284334    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"]
Oct 31 07:32:25.288312 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.288274    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306171    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c6b83e-0379-440f-a69e-05b0d988b9a1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306227    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306258    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306289    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzdjv\" (UniqueName: \"kubernetes.io/projected/61c6b83e-0379-440f-a69e-05b0d988b9a1-kube-api-access-xzdjv\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306324    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76nzh\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-kube-api-access-76nzh\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306350    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7942b45d-8533-4089-a961-751c59ba0591-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306389    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306414    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306448    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306474    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306503    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306537    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306563    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306591    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7942b45d-8533-4089-a961-751c59ba0591-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306616    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306642    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306671    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.307893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.306717    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.310318 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.310286    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"]
Oct 31 07:32:25.311462 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.311358    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7942b45d-8533-4089-a961-751c59ba0591-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.316988 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.315550    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.316988 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.316328    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7942b45d-8533-4089-a961-751c59ba0591-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.316988 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.316689    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.319074 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.317361    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.319074 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.317643    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.329644 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.329593    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-hvwzf\""
Oct 31 07:32:25.331081 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.331050    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.332880 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.332470    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76nzh\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-kube-api-access-76nzh\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.334938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.334892    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-rxdnz\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.357369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.357335    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:25.407568 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.407465    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.407568 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.407529    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.407568 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.407561    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.407876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.407590    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.407876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.407628    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.407876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.407685    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c6b83e-0379-440f-a69e-05b0d988b9a1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.407876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.407734    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.407876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.407765    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzdjv\" (UniqueName: \"kubernetes.io/projected/61c6b83e-0379-440f-a69e-05b0d988b9a1-kube-api-access-xzdjv\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.407876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.407811    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.408526 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.408470    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.410781 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.409993    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.410781 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.410607    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.410781 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.410727    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.411528 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.411471    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61c6b83e-0379-440f-a69e-05b0d988b9a1-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.420100 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.420073    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.423508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.423429    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.429695 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.429664    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61c6b83e-0379-440f-a69e-05b0d988b9a1-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.433725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.433692    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzdjv\" (UniqueName: \"kubernetes.io/projected/61c6b83e-0379-440f-a69e-05b0d988b9a1-kube-api-access-xzdjv\") pod \"openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5\" (UID: \"61c6b83e-0379-440f-a69e-05b0d988b9a1\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.488809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.488766    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:25.490125 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.490097    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:25.664376 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.664288    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:25.849679 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.849624    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"]
Oct 31 07:32:25.998104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:25.998065    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"]
Oct 31 07:32:26.010005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:32:26.009965    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c6b83e_0379_440f_a69e_05b0d988b9a1.slice/crio-93175ee33fd355c37e16419127f90c40419c73ff5bb97a5fd2598c05b2c94ebf WatchSource:0}: Error finding container 93175ee33fd355c37e16419127f90c40419c73ff5bb97a5fd2598c05b2c94ebf: Status 404 returned error can't find the container with id 93175ee33fd355c37e16419127f90c40419c73ff5bb97a5fd2598c05b2c94ebf
Oct 31 07:32:26.852277 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:26.852230    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5" event={"ID":"61c6b83e-0379-440f-a69e-05b0d988b9a1","Type":"ContainerStarted","Data":"93175ee33fd355c37e16419127f90c40419c73ff5bb97a5fd2598c05b2c94ebf"}
Oct 31 07:32:26.854512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:26.854476    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" event={"ID":"7942b45d-8533-4089-a961-751c59ba0591","Type":"ContainerStarted","Data":"1048df5a8f7d356e1f197524b4d489aa1adb917de3ebc3ecb9adf92faffb8bf6"}
Oct 31 07:32:27.869962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.869136    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"]
Oct 31 07:32:27.875706 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.875666    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:27.892158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.892118    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"]
Oct 31 07:32:27.907335 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.905424    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"]
Oct 31 07:32:27.909625 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.909597    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:27.918572 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.918458    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"]
Oct 31 07:32:27.940847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.940368    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:27.940847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.940432    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:27.940847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.940524    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t7jk\" (UniqueName: \"kubernetes.io/projected/277af9f0-861b-4877-a4da-1eb2156edc47-kube-api-access-9t7jk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:27.940847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.940593    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:27.940847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.940657    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:27.940847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:27.940701    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt6lh\" (UniqueName: \"kubernetes.io/projected/33cdaad5-8896-4f13-b099-5bf953d2963d-kube-api-access-lt6lh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.041293    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.041337    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.041390    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t7jk\" (UniqueName: \"kubernetes.io/projected/277af9f0-861b-4877-a4da-1eb2156edc47-kube-api-access-9t7jk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.041436    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.041496    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.041540    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt6lh\" (UniqueName: \"kubernetes.io/projected/33cdaad5-8896-4f13-b099-5bf953d2963d-kube-api-access-lt6lh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.042304    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.042549    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.043128    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:28.043399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.043349    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:28.068025 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.067938    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t7jk\" (UniqueName: \"kubernetes.io/projected/277af9f0-861b-4877-a4da-1eb2156edc47-kube-api-access-9t7jk\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:28.071732 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.071693    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt6lh\" (UniqueName: \"kubernetes.io/projected/33cdaad5-8896-4f13-b099-5bf953d2963d-kube-api-access-lt6lh\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:28.207528 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.207219    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:28.235880 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.235623    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:28.497638 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.497601    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:28.551027 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.550991    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"]
Oct 31 07:32:28.563875 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:32:28.563839    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33cdaad5_8896_4f13_b099_5bf953d2963d.slice/crio-cff87198252269e8381b4dfcbb17dea7043290b4346ed4e42d07f8725518a47f WatchSource:0}: Error finding container cff87198252269e8381b4dfcbb17dea7043290b4346ed4e42d07f8725518a47f: Status 404 returned error can't find the container with id cff87198252269e8381b4dfcbb17dea7043290b4346ed4e42d07f8725518a47f
Oct 31 07:32:28.591288 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.591135    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"]
Oct 31 07:32:28.601180 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:32:28.601141    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod277af9f0_861b_4877_a4da_1eb2156edc47.slice/crio-4d900747464a13ad21014fe120a506fd82f505d82e72304217b68fac9fdbf39e WatchSource:0}: Error finding container 4d900747464a13ad21014fe120a506fd82f505d82e72304217b68fac9fdbf39e: Status 404 returned error can't find the container with id 4d900747464a13ad21014fe120a506fd82f505d82e72304217b68fac9fdbf39e
Oct 31 07:32:28.715360 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:32:28.715269    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:32:28.881324 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.881186    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw" event={"ID":"33cdaad5-8896-4f13-b099-5bf953d2963d","Type":"ContainerStarted","Data":"cff87198252269e8381b4dfcbb17dea7043290b4346ed4e42d07f8725518a47f"}
Oct 31 07:32:28.884060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:28.883994    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x" event={"ID":"277af9f0-861b-4877-a4da-1eb2156edc47","Type":"ContainerStarted","Data":"4d900747464a13ad21014fe120a506fd82f505d82e72304217b68fac9fdbf39e"}
Oct 31 07:32:32.357887 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:32.357826    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:34.918723 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:34.918668    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:32:34.919191 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:34.918776    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:32:34.919191 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:34.918822    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:32:34.952828 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:34.952755    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:32:34.952972 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:34.952853    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:32:34.952972 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:34.952897    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:32:35.981950 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:35.981232    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" event={"ID":"7942b45d-8533-4089-a961-751c59ba0591","Type":"ContainerStarted","Data":"11c73a1f3805424265493b2634d572e7bf6c97754bb10341f50000c8dbfc5da5"}
Oct 31 07:32:35.987214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:35.986418    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5" event={"ID":"61c6b83e-0379-440f-a69e-05b0d988b9a1","Type":"ContainerStarted","Data":"9f545f368edc834ba817f17349d26fefbcf26395f4e15ce463101a0e83481f8a"}
Oct 31 07:32:36.035599 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.034669    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" podStartSLOduration=1.956773163 podStartE2EDuration="11.034648553s" totalImagesPullingTime="9.07787539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:32:36.033369311 +0000 UTC m=+270.562563989" watchObservedRunningTime="2026-10-31 07:32:36.034648553 +0000 UTC m=+270.563843228"
Oct 31 07:32:36.078462 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.078005    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5" podStartSLOduration=2.173283419 podStartE2EDuration="11.077982746s" totalImagesPullingTime="8.904699327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:32:36.077162762 +0000 UTC m=+270.606357439" watchObservedRunningTime="2026-10-31 07:32:36.077982746 +0000 UTC m=+270.607177452"
Oct 31 07:32:36.491236 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.491202    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:36.497342 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.497313    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:36.666858 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.665019    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:36.672086 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.671815    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:36.994399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.994283    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:36.994399 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.994337    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:36.995466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.995426    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:32:36.995528 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:36.995491    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5"
Oct 31 07:32:38.001982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:38.001939    5039 generic.go:356] "Generic (PLEG): container finished" podID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerID="d7bcd914de733fb09da9aefaa4c95ff73750c172ccb23f9f0b9896c3b509d2fd" exitCode=0
Oct 31 07:32:38.002466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:38.002052    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx" event={"ID":"b396ea27-9d30-4c1b-a1e1-e680d2b2d660","Type":"ContainerDied","Data":"d7bcd914de733fb09da9aefaa4c95ff73750c172ccb23f9f0b9896c3b509d2fd"}
Oct 31 07:32:38.007028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:38.006965    5039 generic.go:356] "Generic (PLEG): container finished" podID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerID="fa8e08056f7b072cadf30b6138570cd73b2435c768e3d49319c528198b9f7bba" exitCode=0
Oct 31 07:32:38.007165 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:38.007052    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm" event={"ID":"2f732eef-6b57-4a35-92e4-d3e32394255f","Type":"ContainerDied","Data":"fa8e08056f7b072cadf30b6138570cd73b2435c768e3d49319c528198b9f7bba"}
Oct 31 07:32:38.009713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:38.009688    5039 generic.go:356] "Generic (PLEG): container finished" podID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerID="8e50a8390cde0d0a22add70c0462acf8148886d394b1f11158e79a711609ade3" exitCode=0
Oct 31 07:32:38.009899 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:38.009876    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s" event={"ID":"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf","Type":"ContainerDied","Data":"8e50a8390cde0d0a22add70c0462acf8148886d394b1f11158e79a711609ade3"}
Oct 31 07:32:38.012240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:38.012126    5039 generic.go:356] "Generic (PLEG): container finished" podID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerID="22d6fe9594855e455437ab061e9e3d3f8c01f232b994493cf03f40eca9d30202" exitCode=0
Oct 31 07:32:38.012240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:38.012164    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd" event={"ID":"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b","Type":"ContainerDied","Data":"22d6fe9594855e455437ab061e9e3d3f8c01f232b994493cf03f40eca9d30202"}
Oct 31 07:32:39.019336 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:39.019258    5039 generic.go:356] "Generic (PLEG): container finished" podID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerID="a226f68c9757276972851841d2e658ed0d8cffedff7318ef2770aec2c4c3d91c" exitCode=0
Oct 31 07:32:39.019814 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:39.019341    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw" event={"ID":"33cdaad5-8896-4f13-b099-5bf953d2963d","Type":"ContainerDied","Data":"a226f68c9757276972851841d2e658ed0d8cffedff7318ef2770aec2c4c3d91c"}
Oct 31 07:32:39.021024 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:39.020994    5039 generic.go:356] "Generic (PLEG): container finished" podID="277af9f0-861b-4877-a4da-1eb2156edc47" containerID="b75db5bb25eef68648a35ffaac00f3b89ca54986b1d6568be374622d18cf695e" exitCode=0
Oct 31 07:32:39.021165 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:39.021028    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x" event={"ID":"277af9f0-861b-4877-a4da-1eb2156edc47","Type":"ContainerDied","Data":"b75db5bb25eef68648a35ffaac00f3b89ca54986b1d6568be374622d18cf695e"}
Oct 31 07:32:39.022944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:39.022834    5039 generic.go:356] "Generic (PLEG): container finished" podID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerID="7083bec555e7b8057643796eed870a8f4c862ea58f8a45bf1b5b5e3991116e00" exitCode=0
Oct 31 07:32:39.022944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:39.022884    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z" event={"ID":"0ef46937-30de-4820-b2e6-53fd09e92ad3","Type":"ContainerDied","Data":"7083bec555e7b8057643796eed870a8f4c862ea58f8a45bf1b5b5e3991116e00"}
Oct 31 07:32:40.029176 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.029139    5039 generic.go:356] "Generic (PLEG): container finished" podID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerID="3467f65b3aed221785d0cf3896bafb304938778cf90ce4a61178536a17c61a5f" exitCode=0
Oct 31 07:32:40.029671 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.029224    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd" event={"ID":"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b","Type":"ContainerDied","Data":"3467f65b3aed221785d0cf3896bafb304938778cf90ce4a61178536a17c61a5f"}
Oct 31 07:32:40.031639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.031617    5039 generic.go:356] "Generic (PLEG): container finished" podID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerID="6c36d461b4f5f0c2ad4cffe284782baff259d09150c5f3d20a84402a0e1ebcae" exitCode=0
Oct 31 07:32:40.031750 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.031702    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw" event={"ID":"33cdaad5-8896-4f13-b099-5bf953d2963d","Type":"ContainerDied","Data":"6c36d461b4f5f0c2ad4cffe284782baff259d09150c5f3d20a84402a0e1ebcae"}
Oct 31 07:32:40.033505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.033481    5039 generic.go:356] "Generic (PLEG): container finished" podID="d47f13b7-997a-4707-8ed3-288a15508dad" containerID="95c7faf4d5ea167be7fcf87755ad8768e04bdf6c75fcc8a6bfab80e51825558d" exitCode=0
Oct 31 07:32:40.033629 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.033549    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2" event={"ID":"d47f13b7-997a-4707-8ed3-288a15508dad","Type":"ContainerDied","Data":"95c7faf4d5ea167be7fcf87755ad8768e04bdf6c75fcc8a6bfab80e51825558d"}
Oct 31 07:32:40.035652 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.035616    5039 generic.go:356] "Generic (PLEG): container finished" podID="277af9f0-861b-4877-a4da-1eb2156edc47" containerID="9fd995aea710546d1a291ebe095dcfd719d08040a49093564eeb998d5482b525" exitCode=0
Oct 31 07:32:40.035733 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.035706    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x" event={"ID":"277af9f0-861b-4877-a4da-1eb2156edc47","Type":"ContainerDied","Data":"9fd995aea710546d1a291ebe095dcfd719d08040a49093564eeb998d5482b525"}
Oct 31 07:32:40.037716 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.037686    5039 generic.go:356] "Generic (PLEG): container finished" podID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerID="e488d2016518bad06f6947e5215241fce0e8bdf37440ba8494b81ebf0007400a" exitCode=0
Oct 31 07:32:40.037818 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.037781    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx" event={"ID":"b396ea27-9d30-4c1b-a1e1-e680d2b2d660","Type":"ContainerDied","Data":"e488d2016518bad06f6947e5215241fce0e8bdf37440ba8494b81ebf0007400a"}
Oct 31 07:32:40.039762 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.039743    5039 generic.go:356] "Generic (PLEG): container finished" podID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerID="8c0646c4bee03e1d0fe60236628838a08ffdd542c071340d0ee829545e123634" exitCode=0
Oct 31 07:32:40.039851 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.039828    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm" event={"ID":"2f732eef-6b57-4a35-92e4-d3e32394255f","Type":"ContainerDied","Data":"8c0646c4bee03e1d0fe60236628838a08ffdd542c071340d0ee829545e123634"}
Oct 31 07:32:40.049794 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.041956    5039 generic.go:356] "Generic (PLEG): container finished" podID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerID="9f20c85abc019ba4d99d1c23a3e4c946e37e4701df4090af9160dce8ae072d7f" exitCode=0
Oct 31 07:32:40.049794 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:40.041992    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s" event={"ID":"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf","Type":"ContainerDied","Data":"9f20c85abc019ba4d99d1c23a3e4c946e37e4701df4090af9160dce8ae072d7f"}
Oct 31 07:32:41.055257 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:41.055057    5039 generic.go:356] "Generic (PLEG): container finished" podID="d47f13b7-997a-4707-8ed3-288a15508dad" containerID="5289fad4558b86f53c2e5562cacf9971c03d773017eeaa4140328a387551ee71" exitCode=0
Oct 31 07:32:41.055257 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:41.055126    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2" event={"ID":"d47f13b7-997a-4707-8ed3-288a15508dad","Type":"ContainerDied","Data":"5289fad4558b86f53c2e5562cacf9971c03d773017eeaa4140328a387551ee71"}
Oct 31 07:32:44.098952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:44.098888    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z" event={"ID":"0ef46937-30de-4820-b2e6-53fd09e92ad3","Type":"ContainerStarted","Data":"996c88e58098a40e5be9f399335a92e4501ad21e4cb09ef1e60e108bb8440216"}
Oct 31 07:32:45.116234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:45.116096    5039 generic.go:356] "Generic (PLEG): container finished" podID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerID="996c88e58098a40e5be9f399335a92e4501ad21e4cb09ef1e60e108bb8440216" exitCode=0
Oct 31 07:32:45.116234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:45.116170    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z" event={"ID":"0ef46937-30de-4820-b2e6-53fd09e92ad3","Type":"ContainerDied","Data":"996c88e58098a40e5be9f399335a92e4501ad21e4cb09ef1e60e108bb8440216"}
Oct 31 07:32:46.491985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:46.489341    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:47.274870 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:47.274835    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:50.064120 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:50.064078    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:50.177170 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:50.177112    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:51.912286 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:51.912167    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:52.038729 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:52.038682    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:54.272342 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:54.272282    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:54.532126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:54.531901    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:54.871359 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:54.871231    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:54.979309 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:54.979210    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:55.564070 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:55.563946    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:32:57.237242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:57.237206    5039 generic.go:356] "Generic (PLEG): container finished" podID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerID="ea5f19f696d924e62b609f295052c854f0c0d8cb9d0a63b6592f2fbc637bb583" exitCode=0
Oct 31 07:32:57.237813 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:57.237571    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw" event={"ID":"33cdaad5-8896-4f13-b099-5bf953d2963d","Type":"ContainerDied","Data":"ea5f19f696d924e62b609f295052c854f0c0d8cb9d0a63b6592f2fbc637bb583"}
Oct 31 07:32:58.247518 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.246728    5039 generic.go:356] "Generic (PLEG): container finished" podID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerID="df812f82d68d01260117c8e36a00a8b14f2af4041540f807a4f9f41c7caf0caf" exitCode=0
Oct 31 07:32:58.247518 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.246909    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd" event={"ID":"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b","Type":"ContainerDied","Data":"df812f82d68d01260117c8e36a00a8b14f2af4041540f807a4f9f41c7caf0caf"}
Oct 31 07:32:58.250397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.250351    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2" event={"ID":"d47f13b7-997a-4707-8ed3-288a15508dad","Type":"ContainerStarted","Data":"838b48712869f3f4c66c0746ad1c79a3aeca2135a16d0ba20a28d6c8e403c0ae"}
Oct 31 07:32:58.253698 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.253665    5039 generic.go:356] "Generic (PLEG): container finished" podID="277af9f0-861b-4877-a4da-1eb2156edc47" containerID="a23f9c7755375e83c8d504410a9d3671cc78ac3379f77964224447cbe9f39693" exitCode=0
Oct 31 07:32:58.253804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.253758    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x" event={"ID":"277af9f0-861b-4877-a4da-1eb2156edc47","Type":"ContainerDied","Data":"a23f9c7755375e83c8d504410a9d3671cc78ac3379f77964224447cbe9f39693"}
Oct 31 07:32:58.256608 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.256578    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx" event={"ID":"b396ea27-9d30-4c1b-a1e1-e680d2b2d660","Type":"ContainerStarted","Data":"03e6c23688625467a23f1e9aff1cf6fa4eb3314b2f89dc84945434050685e5d7"}
Oct 31 07:32:58.260280 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.260251    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm" event={"ID":"2f732eef-6b57-4a35-92e4-d3e32394255f","Type":"ContainerStarted","Data":"9a82af6dd16f4eae62e79c870b8f5c08ad55e5878690be4e876dad4841e37cdc"}
Oct 31 07:32:58.263795 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.263758    5039 generic.go:356] "Generic (PLEG): container finished" podID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerID="058e5ed062ea1c17024c44fcc4df305f7ff9aa64c2cc85808618dd1a40a2e201" exitCode=0
Oct 31 07:32:58.264143 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.264117    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s" event={"ID":"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf","Type":"ContainerDied","Data":"058e5ed062ea1c17024c44fcc4df305f7ff9aa64c2cc85808618dd1a40a2e201"}
Oct 31 07:32:58.330955 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.329684    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx" podStartSLOduration=3.223910239 podStartE2EDuration="38.329660823s" totalImagesPullingTime="35.105750584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:32:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:32:58.328169456 +0000 UTC m=+292.857364132" watchObservedRunningTime="2026-10-31 07:32:58.329660823 +0000 UTC m=+292.858855499"
Oct 31 07:32:58.368996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.368894    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2" podStartSLOduration=2.6549088100000002 podStartE2EDuration="35.368873513s" totalImagesPullingTime="32.713964703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:32:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:32:58.367841956 +0000 UTC m=+292.897036631" watchObservedRunningTime="2026-10-31 07:32:58.368873513 +0000 UTC m=+292.898068188"
Oct 31 07:32:58.407283 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.407222    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm" podStartSLOduration=3.6207553900000002 podStartE2EDuration="38.40720298s" totalImagesPullingTime="34.78644759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:32:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:32:58.406408441 +0000 UTC m=+292.935603116" watchObservedRunningTime="2026-10-31 07:32:58.40720298 +0000 UTC m=+292.936397651"
Oct 31 07:32:58.448275 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.448245    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:58.481869 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.481819    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-util\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-util\") pod \"33cdaad5-8896-4f13-b099-5bf953d2963d\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") "
Oct 31 07:32:58.482076 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.481884    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-bundle\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-bundle\") pod \"33cdaad5-8896-4f13-b099-5bf953d2963d\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") "
Oct 31 07:32:58.482076 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.482015    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/33cdaad5-8896-4f13-b099-5bf953d2963d-kube-api-access-lt6lh\" (UniqueName: \"kubernetes.io/projected/33cdaad5-8896-4f13-b099-5bf953d2963d-kube-api-access-lt6lh\") pod \"33cdaad5-8896-4f13-b099-5bf953d2963d\" (UID: \"33cdaad5-8896-4f13-b099-5bf953d2963d\") "
Oct 31 07:32:58.482449 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.482414    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-bundle" pod "33cdaad5-8896-4f13-b099-5bf953d2963d" (UID: "33cdaad5-8896-4f13-b099-5bf953d2963d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:32:58.485570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.485534    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33cdaad5-8896-4f13-b099-5bf953d2963d-kube-api-access-lt6lh" pod "33cdaad5-8896-4f13-b099-5bf953d2963d" (UID: "33cdaad5-8896-4f13-b099-5bf953d2963d"). InnerVolumeSpecName "kube-api-access-lt6lh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:32:58.488051 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.488026    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-util" pod "33cdaad5-8896-4f13-b099-5bf953d2963d" (UID: "33cdaad5-8896-4f13-b099-5bf953d2963d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:32:58.582928 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.582883    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt6lh\" (UniqueName: \"kubernetes.io/projected/33cdaad5-8896-4f13-b099-5bf953d2963d-kube-api-access-lt6lh\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:58.582928 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.582943    5039 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-util\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:58.583171 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:58.582958    5039 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/33cdaad5-8896-4f13-b099-5bf953d2963d-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:58.699723 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:32:58.699634    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:32:59.270521 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.270486    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw" event={"ID":"33cdaad5-8896-4f13-b099-5bf953d2963d","Type":"ContainerDied","Data":"cff87198252269e8381b4dfcbb17dea7043290b4346ed4e42d07f8725518a47f"}
Oct 31 07:32:59.270959 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.270544    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cff87198252269e8381b4dfcbb17dea7043290b4346ed4e42d07f8725518a47f"
Oct 31 07:32:59.270959 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.270495    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4ckf7zw"
Oct 31 07:32:59.272979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.272945    5039 generic.go:356] "Generic (PLEG): container finished" podID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerID="03e6c23688625467a23f1e9aff1cf6fa4eb3314b2f89dc84945434050685e5d7" exitCode=0
Oct 31 07:32:59.273113 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.273063    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx" event={"ID":"b396ea27-9d30-4c1b-a1e1-e680d2b2d660","Type":"ContainerDied","Data":"03e6c23688625467a23f1e9aff1cf6fa4eb3314b2f89dc84945434050685e5d7"}
Oct 31 07:32:59.275339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.275316    5039 generic.go:356] "Generic (PLEG): container finished" podID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerID="9a82af6dd16f4eae62e79c870b8f5c08ad55e5878690be4e876dad4841e37cdc" exitCode=0
Oct 31 07:32:59.275456 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.275407    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm" event={"ID":"2f732eef-6b57-4a35-92e4-d3e32394255f","Type":"ContainerDied","Data":"9a82af6dd16f4eae62e79c870b8f5c08ad55e5878690be4e876dad4841e37cdc"}
Oct 31 07:32:59.421267 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.421244    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:32:59.476369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.476343    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:32:59.479308 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.479283    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:32:59.492554 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.492527    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-util\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-util\") pod \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") "
Oct 31 07:32:59.492713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.492565    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-kube-api-access-sxkdq\" (UniqueName: \"kubernetes.io/projected/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-kube-api-access-sxkdq\") pod \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") "
Oct 31 07:32:59.492713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.492601    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-util\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-util\") pod \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") "
Oct 31 07:32:59.492713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.492626    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-util\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-util\") pod \"277af9f0-861b-4877-a4da-1eb2156edc47\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") "
Oct 31 07:32:59.492713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.492667    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/277af9f0-861b-4877-a4da-1eb2156edc47-kube-api-access-9t7jk\" (UniqueName: \"kubernetes.io/projected/277af9f0-861b-4877-a4da-1eb2156edc47-kube-api-access-9t7jk\") pod \"277af9f0-861b-4877-a4da-1eb2156edc47\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") "
Oct 31 07:32:59.492713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.492684    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-bundle\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-bundle\") pod \"277af9f0-861b-4877-a4da-1eb2156edc47\" (UID: \"277af9f0-861b-4877-a4da-1eb2156edc47\") "
Oct 31 07:32:59.492713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.492707    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-kube-api-access-xmkvl\" (UniqueName: \"kubernetes.io/projected/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-kube-api-access-xmkvl\") pod \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") "
Oct 31 07:32:59.493060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.492777    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-bundle\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-bundle\") pod \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\" (UID: \"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf\") "
Oct 31 07:32:59.493060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.492847    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-bundle\") pod \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\" (UID: \"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b\") "
Oct 31 07:32:59.494875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.493766    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-bundle" pod "277af9f0-861b-4877-a4da-1eb2156edc47" (UID: "277af9f0-861b-4877-a4da-1eb2156edc47"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:32:59.494875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.493794    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-bundle" pod "3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" (UID: "3aa0b826-c7ad-45d0-876c-dfa7f9daf74b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:32:59.494875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.494833    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-bundle" pod "08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" (UID: "08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:32:59.495272 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.495243    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-kube-api-access-sxkdq" pod "3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" (UID: "3aa0b826-c7ad-45d0-876c-dfa7f9daf74b"). InnerVolumeSpecName "kube-api-access-sxkdq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:32:59.495422 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.495299    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-kube-api-access-xmkvl" pod "08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" (UID: "08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf"). InnerVolumeSpecName "kube-api-access-xmkvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:32:59.496112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.496080    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/277af9f0-861b-4877-a4da-1eb2156edc47-kube-api-access-9t7jk" pod "277af9f0-861b-4877-a4da-1eb2156edc47" (UID: "277af9f0-861b-4877-a4da-1eb2156edc47"). InnerVolumeSpecName "kube-api-access-9t7jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:32:59.499665 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.499640    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-util" pod "3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" (UID: "3aa0b826-c7ad-45d0-876c-dfa7f9daf74b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:32:59.499904 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.499882    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-util" pod "277af9f0-861b-4877-a4da-1eb2156edc47" (UID: "277af9f0-861b-4877-a4da-1eb2156edc47"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:32:59.500617 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.500593    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-util" pod "08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" (UID: "08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:32:59.593684 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.593651    5039 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:59.593684 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.593684    5039 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:59.593889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.593696    5039 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-util\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:59.593889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.593708    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxkdq\" (UniqueName: \"kubernetes.io/projected/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-kube-api-access-sxkdq\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:59.593889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.593720    5039 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3aa0b826-c7ad-45d0-876c-dfa7f9daf74b-util\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:59.593889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.593732    5039 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-util\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:59.593889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.593742    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t7jk\" (UniqueName: \"kubernetes.io/projected/277af9f0-861b-4877-a4da-1eb2156edc47-kube-api-access-9t7jk\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:59.593889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.593753    5039 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/277af9f0-861b-4877-a4da-1eb2156edc47-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:32:59.593889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:32:59.593767    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmkvl\" (UniqueName: \"kubernetes.io/projected/08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf-kube-api-access-xmkvl\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:00.282419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.282385    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s"
Oct 31 07:33:00.282982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.282386    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cnht5s" event={"ID":"08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf","Type":"ContainerDied","Data":"91756b62a0b6e10117fb803566d2fbaaabb6fd0caca83fa7e01c0fef630afef5"}
Oct 31 07:33:00.282982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.282514    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91756b62a0b6e10117fb803566d2fbaaabb6fd0caca83fa7e01c0fef630afef5"
Oct 31 07:33:00.284564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.284533    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd" event={"ID":"3aa0b826-c7ad-45d0-876c-dfa7f9daf74b","Type":"ContainerDied","Data":"b08cb72c4bec564ede260b7a8b6645f682e65c9852022def2122ebfa3fb963c3"}
Oct 31 07:33:00.284691 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.284590    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b08cb72c4bec564ede260b7a8b6645f682e65c9852022def2122ebfa3fb963c3"
Oct 31 07:33:00.284691 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.284547    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ajddwd"
Oct 31 07:33:00.286617 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.286596    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x"
Oct 31 07:33:00.286741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.286616    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847avfx4x" event={"ID":"277af9f0-861b-4877-a4da-1eb2156edc47","Type":"ContainerDied","Data":"4d900747464a13ad21014fe120a506fd82f505d82e72304217b68fac9fdbf39e"}
Oct 31 07:33:00.286741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.286655    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d900747464a13ad21014fe120a506fd82f505d82e72304217b68fac9fdbf39e"
Oct 31 07:33:00.288943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.288908    5039 generic.go:356] "Generic (PLEG): container finished" podID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerID="a7171cea1af0819b3bb2bfa559fda4b8182ea06f5f7a822666772a6e30425fa8" exitCode=0
Oct 31 07:33:00.289047 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.288945    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z" event={"ID":"0ef46937-30de-4820-b2e6-53fd09e92ad3","Type":"ContainerDied","Data":"a7171cea1af0819b3bb2bfa559fda4b8182ea06f5f7a822666772a6e30425fa8"}
Oct 31 07:33:00.427630 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.427605    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:33:00.456449 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.456417    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:33:00.501166 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.501133    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2f732eef-6b57-4a35-92e4-d3e32394255f-kube-api-access-6n557\" (UniqueName: \"kubernetes.io/projected/2f732eef-6b57-4a35-92e4-d3e32394255f-kube-api-access-6n557\") pod \"2f732eef-6b57-4a35-92e4-d3e32394255f\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") "
Oct 31 07:33:00.501371 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.501197    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-util\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-util\") pod \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") "
Oct 31 07:33:00.501371 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.501262    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-bundle\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-bundle\") pod \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") "
Oct 31 07:33:00.501371 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.501303    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-util\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-util\") pod \"2f732eef-6b57-4a35-92e4-d3e32394255f\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") "
Oct 31 07:33:00.501371 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.501340    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-kube-api-access-25mcm\" (UniqueName: \"kubernetes.io/projected/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-kube-api-access-25mcm\") pod \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\" (UID: \"b396ea27-9d30-4c1b-a1e1-e680d2b2d660\") "
Oct 31 07:33:00.501600 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.501408    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-bundle\") pod \"2f732eef-6b57-4a35-92e4-d3e32394255f\" (UID: \"2f732eef-6b57-4a35-92e4-d3e32394255f\") "
Oct 31 07:33:00.501875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.501839    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-bundle" pod "b396ea27-9d30-4c1b-a1e1-e680d2b2d660" (UID: "b396ea27-9d30-4c1b-a1e1-e680d2b2d660"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:00.502095 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.502067    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-bundle" pod "2f732eef-6b57-4a35-92e4-d3e32394255f" (UID: "2f732eef-6b57-4a35-92e4-d3e32394255f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:00.504102 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.503860    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-kube-api-access-25mcm" pod "b396ea27-9d30-4c1b-a1e1-e680d2b2d660" (UID: "b396ea27-9d30-4c1b-a1e1-e680d2b2d660"). InnerVolumeSpecName "kube-api-access-25mcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:33:00.504354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.504329    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f732eef-6b57-4a35-92e4-d3e32394255f-kube-api-access-6n557" pod "2f732eef-6b57-4a35-92e4-d3e32394255f" (UID: "2f732eef-6b57-4a35-92e4-d3e32394255f"). InnerVolumeSpecName "kube-api-access-6n557". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:33:00.508587 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.508559    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-util" pod "b396ea27-9d30-4c1b-a1e1-e680d2b2d660" (UID: "b396ea27-9d30-4c1b-a1e1-e680d2b2d660"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:00.508858 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.508834    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-util" pod "2f732eef-6b57-4a35-92e4-d3e32394255f" (UID: "2f732eef-6b57-4a35-92e4-d3e32394255f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:00.602045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.601960    5039 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:00.602045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.601990    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6n557\" (UniqueName: \"kubernetes.io/projected/2f732eef-6b57-4a35-92e4-d3e32394255f-kube-api-access-6n557\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:00.602045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.602002    5039 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-util\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:00.602045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.602010    5039 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:00.602045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.602018    5039 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2f732eef-6b57-4a35-92e4-d3e32394255f-util\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:00.602045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:00.602027    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25mcm\" (UniqueName: \"kubernetes.io/projected/b396ea27-9d30-4c1b-a1e1-e680d2b2d660-kube-api-access-25mcm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:01.296009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.295968    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx" event={"ID":"b396ea27-9d30-4c1b-a1e1-e680d2b2d660","Type":"ContainerDied","Data":"b0a368c0b04b8847d7d991561aa5e2cf0a022e4ae4517c73b8c881047620a46f"}
Oct 31 07:33:01.296009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.295990    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7w92kx"
Oct 31 07:33:01.296499 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.296052    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0a368c0b04b8847d7d991561aa5e2cf0a022e4ae4517c73b8c881047620a46f"
Oct 31 07:33:01.298101 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.298083    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm"
Oct 31 07:33:01.298205 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.298096    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lcsxm" event={"ID":"2f732eef-6b57-4a35-92e4-d3e32394255f","Type":"ContainerDied","Data":"74763bb6225a2b2d30445c39b029d8b21c5c65584d4f0b83fc06e19f131bab9d"}
Oct 31 07:33:01.298205 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.298140    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74763bb6225a2b2d30445c39b029d8b21c5c65584d4f0b83fc06e19f131bab9d"
Oct 31 07:33:01.433020 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.432991    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:33:01.500345 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.500312    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:01.509801 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.509772    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-bundle\") pod \"0ef46937-30de-4820-b2e6-53fd09e92ad3\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") "
Oct 31 07:33:01.509954 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.509817    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-util\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-util\") pod \"0ef46937-30de-4820-b2e6-53fd09e92ad3\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") "
Oct 31 07:33:01.509954 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.509862    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0ef46937-30de-4820-b2e6-53fd09e92ad3-kube-api-access-7cskf\" (UniqueName: \"kubernetes.io/projected/0ef46937-30de-4820-b2e6-53fd09e92ad3-kube-api-access-7cskf\") pod \"0ef46937-30de-4820-b2e6-53fd09e92ad3\" (UID: \"0ef46937-30de-4820-b2e6-53fd09e92ad3\") "
Oct 31 07:33:01.510270 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.510235    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-bundle" pod "0ef46937-30de-4820-b2e6-53fd09e92ad3" (UID: "0ef46937-30de-4820-b2e6-53fd09e92ad3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:01.512086 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.512051    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ef46937-30de-4820-b2e6-53fd09e92ad3-kube-api-access-7cskf" pod "0ef46937-30de-4820-b2e6-53fd09e92ad3" (UID: "0ef46937-30de-4820-b2e6-53fd09e92ad3"). InnerVolumeSpecName "kube-api-access-7cskf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:33:01.515307 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.515281    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-util" pod "0ef46937-30de-4820-b2e6-53fd09e92ad3" (UID: "0ef46937-30de-4820-b2e6-53fd09e92ad3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:01.610998 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.610874    5039 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:01.610998 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.610907    5039 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ef46937-30de-4820-b2e6-53fd09e92ad3-util\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:01.610998 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:01.610948    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cskf\" (UniqueName: \"kubernetes.io/projected/0ef46937-30de-4820-b2e6-53fd09e92ad3-kube-api-access-7cskf\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:02.304740 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:02.304707    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z" event={"ID":"0ef46937-30de-4820-b2e6-53fd09e92ad3","Type":"ContainerDied","Data":"170fbd40ff5f4d4f062f89a70124fefd0d316b23ae8d32b5fb4ea9871c620943"}
Oct 31 07:33:02.305171 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:02.304759    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="170fbd40ff5f4d4f062f89a70124fefd0d316b23ae8d32b5fb4ea9871c620943"
Oct 31 07:33:02.305171 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:02.304716    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e6444wm4z"
Oct 31 07:33:03.081867 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.081832    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-7m25h"]
Oct 31 07:33:03.082189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082173    5039 cpu_manager.go:414] "containerMap: removing container" podUID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerName="extract"
Oct 31 07:33:03.082189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082190    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerName="extract"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082217    5039 cpu_manager.go:414] "containerMap: removing container" podUID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerName="util"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082224    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerName="util"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082235    5039 cpu_manager.go:414] "containerMap: removing container" podUID="277af9f0-861b-4877-a4da-1eb2156edc47" containerName="pull"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082243    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="277af9f0-861b-4877-a4da-1eb2156edc47" containerName="pull"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082254    5039 cpu_manager.go:414] "containerMap: removing container" podUID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerName="pull"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082261    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerName="pull"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082273    5039 cpu_manager.go:414] "containerMap: removing container" podUID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerName="extract"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082278    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerName="extract"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082286    5039 cpu_manager.go:414] "containerMap: removing container" podUID="277af9f0-861b-4877-a4da-1eb2156edc47" containerName="extract"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082290    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="277af9f0-861b-4877-a4da-1eb2156edc47" containerName="extract"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082299    5039 cpu_manager.go:414] "containerMap: removing container" podUID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerName="pull"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082306    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerName="pull"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082315    5039 cpu_manager.go:414] "containerMap: removing container" podUID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerName="extract"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082322    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerName="extract"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082337    5039 cpu_manager.go:414] "containerMap: removing container" podUID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerName="pull"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082344    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerName="pull"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082353    5039 cpu_manager.go:414] "containerMap: removing container" podUID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerName="pull"
Oct 31 07:33:03.082351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082360    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerName="pull"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082372    5039 cpu_manager.go:414] "containerMap: removing container" podUID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082378    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082393    5039 cpu_manager.go:414] "containerMap: removing container" podUID="277af9f0-861b-4877-a4da-1eb2156edc47" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082400    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="277af9f0-861b-4877-a4da-1eb2156edc47" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082411    5039 cpu_manager.go:414] "containerMap: removing container" podUID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082418    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082429    5039 cpu_manager.go:414] "containerMap: removing container" podUID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerName="pull"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082435    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerName="pull"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082445    5039 cpu_manager.go:414] "containerMap: removing container" podUID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082450    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082461    5039 cpu_manager.go:414] "containerMap: removing container" podUID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082469    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082480    5039 cpu_manager.go:414] "containerMap: removing container" podUID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082487    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082498    5039 cpu_manager.go:414] "containerMap: removing container" podUID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082505    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerName="util"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082515    5039 cpu_manager.go:414] "containerMap: removing container" podUID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerName="pull"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082523    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerName="pull"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082531    5039 cpu_manager.go:414] "containerMap: removing container" podUID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082537    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082547    5039 cpu_manager.go:414] "containerMap: removing container" podUID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082554    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082669    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="2f732eef-6b57-4a35-92e4-d3e32394255f" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082683    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="3aa0b826-c7ad-45d0-876c-dfa7f9daf74b" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082690    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="0ef46937-30de-4820-b2e6-53fd09e92ad3" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082699    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="08e8dfa3-2243-41b2-8c47-8c61b1e8d5bf" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082706    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="33cdaad5-8896-4f13-b099-5bf953d2963d" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082712    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="277af9f0-861b-4877-a4da-1eb2156edc47" containerName="extract"
Oct 31 07:33:03.083019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.082720    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="b396ea27-9d30-4c1b-a1e1-e680d2b2d660" containerName="extract"
Oct 31 07:33:03.085890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.085872    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-7m25h"
Oct 31 07:33:03.102697 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.102670    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 31 07:33:03.104342 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.104315    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-7m25h"]
Oct 31 07:33:03.105150 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.105125    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 31 07:33:03.114729 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.114707    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-f88rk\""
Oct 31 07:33:03.123095 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.123066    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88c6e72f-0b6a-4126-8443-8080efca1d8e-bound-sa-token\") pod \"cert-manager-597b95cb84-7m25h\" (UID: \"88c6e72f-0b6a-4126-8443-8080efca1d8e\") " pod="cert-manager/cert-manager-597b95cb84-7m25h"
Oct 31 07:33:03.123215 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.123124    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8w9h\" (UniqueName: \"kubernetes.io/projected/88c6e72f-0b6a-4126-8443-8080efca1d8e-kube-api-access-l8w9h\") pod \"cert-manager-597b95cb84-7m25h\" (UID: \"88c6e72f-0b6a-4126-8443-8080efca1d8e\") " pod="cert-manager/cert-manager-597b95cb84-7m25h"
Oct 31 07:33:03.224484 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.224445    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88c6e72f-0b6a-4126-8443-8080efca1d8e-bound-sa-token\") pod \"cert-manager-597b95cb84-7m25h\" (UID: \"88c6e72f-0b6a-4126-8443-8080efca1d8e\") " pod="cert-manager/cert-manager-597b95cb84-7m25h"
Oct 31 07:33:03.224671 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.224511    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8w9h\" (UniqueName: \"kubernetes.io/projected/88c6e72f-0b6a-4126-8443-8080efca1d8e-kube-api-access-l8w9h\") pod \"cert-manager-597b95cb84-7m25h\" (UID: \"88c6e72f-0b6a-4126-8443-8080efca1d8e\") " pod="cert-manager/cert-manager-597b95cb84-7m25h"
Oct 31 07:33:03.243477 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.243444    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88c6e72f-0b6a-4126-8443-8080efca1d8e-bound-sa-token\") pod \"cert-manager-597b95cb84-7m25h\" (UID: \"88c6e72f-0b6a-4126-8443-8080efca1d8e\") " pod="cert-manager/cert-manager-597b95cb84-7m25h"
Oct 31 07:33:03.243634 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.243531    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8w9h\" (UniqueName: \"kubernetes.io/projected/88c6e72f-0b6a-4126-8443-8080efca1d8e-kube-api-access-l8w9h\") pod \"cert-manager-597b95cb84-7m25h\" (UID: \"88c6e72f-0b6a-4126-8443-8080efca1d8e\") " pod="cert-manager/cert-manager-597b95cb84-7m25h"
Oct 31 07:33:03.387199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.387114    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:03.409459 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.409423    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-7m25h"
Oct 31 07:33:03.499319 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.499283    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:03.728910 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:03.728850    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-7m25h"]
Oct 31 07:33:03.734041 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:33:03.734009    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88c6e72f_0b6a_4126_8443_8080efca1d8e.slice/crio-7cdb278cf9c98de91b9f6d19d7f77d3fa685645367176060816d0e667741fb06 WatchSource:0}: Error finding container 7cdb278cf9c98de91b9f6d19d7f77d3fa685645367176060816d0e667741fb06: Status 404 returned error can't find the container with id 7cdb278cf9c98de91b9f6d19d7f77d3fa685645367176060816d0e667741fb06
Oct 31 07:33:04.326610 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:04.326562    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-7m25h" event={"ID":"88c6e72f-0b6a-4126-8443-8080efca1d8e","Type":"ContainerStarted","Data":"7cdb278cf9c98de91b9f6d19d7f77d3fa685645367176060816d0e667741fb06"}
Oct 31 07:33:05.537093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:05.537053    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:05.647552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:05.647520    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:33:05.649155 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:05.649126    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:33:07.343150 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:07.343106    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-7m25h" event={"ID":"88c6e72f-0b6a-4126-8443-8080efca1d8e","Type":"ContainerStarted","Data":"2abb12caed53059f1b5ed1b3edfa2bb3bc5abf31e24057d157510edf220ff0f4"}
Oct 31 07:33:07.379779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:07.379720    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-7m25h" podStartSLOduration=1.444956089 podStartE2EDuration="4.379705188s" totalImagesPullingTime="2.934749099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:33:07.378899679 +0000 UTC m=+301.908094354" watchObservedRunningTime="2026-10-31 07:33:07.379705188 +0000 UTC m=+301.908899861"
Oct 31 07:33:08.349582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:08.349502    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:33:08.350254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:08.350227    5039 generic.go:356] "Generic (PLEG): container finished" podID="d47f13b7-997a-4707-8ed3-288a15508dad" containerID="838b48712869f3f4c66c0746ad1c79a3aeca2135a16d0ba20a28d6c8e403c0ae" exitCode=1
Oct 31 07:33:08.350341 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:08.350267    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2" event={"ID":"d47f13b7-997a-4707-8ed3-288a15508dad","Type":"ContainerDied","Data":"838b48712869f3f4c66c0746ad1c79a3aeca2135a16d0ba20a28d6c8e403c0ae"}
Oct 31 07:33:09.484325 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.484302    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:33:09.487421 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.487399    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:33:09.587085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.587047    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-util\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-util\") pod \"d47f13b7-997a-4707-8ed3-288a15508dad\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") "
Oct 31 07:33:09.587270 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.587122    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d47f13b7-997a-4707-8ed3-288a15508dad-kube-api-access-ztmj9\" (UniqueName: \"kubernetes.io/projected/d47f13b7-997a-4707-8ed3-288a15508dad-kube-api-access-ztmj9\") pod \"d47f13b7-997a-4707-8ed3-288a15508dad\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") "
Oct 31 07:33:09.587270 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.587191    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-bundle\") pod \"d47f13b7-997a-4707-8ed3-288a15508dad\" (UID: \"d47f13b7-997a-4707-8ed3-288a15508dad\") "
Oct 31 07:33:09.587810 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.587781    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-bundle" pod "d47f13b7-997a-4707-8ed3-288a15508dad" (UID: "d47f13b7-997a-4707-8ed3-288a15508dad"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:09.589391 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.589358    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47f13b7-997a-4707-8ed3-288a15508dad-kube-api-access-ztmj9" pod "d47f13b7-997a-4707-8ed3-288a15508dad" (UID: "d47f13b7-997a-4707-8ed3-288a15508dad"). InnerVolumeSpecName "kube-api-access-ztmj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:33:09.592778 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.592756    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-util" pod "d47f13b7-997a-4707-8ed3-288a15508dad" (UID: "d47f13b7-997a-4707-8ed3-288a15508dad"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:09.688373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.688330    5039 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-util\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:09.688373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.688371    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztmj9\" (UniqueName: \"kubernetes.io/projected/d47f13b7-997a-4707-8ed3-288a15508dad-kube-api-access-ztmj9\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:09.688592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:09.688387    5039 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d47f13b7-997a-4707-8ed3-288a15508dad-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:10.360878 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:10.360848    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:33:10.361574 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:10.361557    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2"
Oct 31 07:33:10.361654 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:10.361556    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2" event={"ID":"d47f13b7-997a-4707-8ed3-288a15508dad","Type":"ContainerDied","Data":"d537863320b4295c60e8742a4e33792d711016b689a5b2c84470569e1bcead44"}
Oct 31 07:33:10.361692 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:10.361674    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d537863320b4295c60e8742a4e33792d711016b689a5b2c84470569e1bcead44"
Oct 31 07:33:11.735565 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:11.735521    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:14.918155 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.918120    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"]
Oct 31 07:33:14.918743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.918717    5039 cpu_manager.go:414] "containerMap: removing container" podUID="d47f13b7-997a-4707-8ed3-288a15508dad" containerName="pull"
Oct 31 07:33:14.918743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.918740    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d47f13b7-997a-4707-8ed3-288a15508dad" containerName="pull"
Oct 31 07:33:14.918951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.918754    5039 cpu_manager.go:414] "containerMap: removing container" podUID="d47f13b7-997a-4707-8ed3-288a15508dad" containerName="util"
Oct 31 07:33:14.918951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.918759    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d47f13b7-997a-4707-8ed3-288a15508dad" containerName="util"
Oct 31 07:33:14.918951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.918769    5039 cpu_manager.go:414] "containerMap: removing container" podUID="d47f13b7-997a-4707-8ed3-288a15508dad" containerName="extract"
Oct 31 07:33:14.918951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.918774    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d47f13b7-997a-4707-8ed3-288a15508dad" containerName="extract"
Oct 31 07:33:14.918951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.918844    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="d47f13b7-997a-4707-8ed3-288a15508dad" containerName="extract"
Oct 31 07:33:14.922091 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.922075    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"
Oct 31 07:33:14.950475 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.950438    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hjf2t\""
Oct 31 07:33:14.950691 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.950460    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 31 07:33:14.950691 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.950486    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 31 07:33:14.952267 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:14.952246    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"]
Oct 31 07:33:15.032949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:15.032897    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44vt8\" (UniqueName: \"kubernetes.io/projected/10509ed9-43ef-4192-ab5e-8810571c1f5e-kube-api-access-44vt8\") pod \"limitador-operator-controller-manager-5778bb4449-pk5mk\" (UID: \"10509ed9-43ef-4192-ab5e-8810571c1f5e\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"
Oct 31 07:33:15.133638 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:15.133593    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44vt8\" (UniqueName: \"kubernetes.io/projected/10509ed9-43ef-4192-ab5e-8810571c1f5e-kube-api-access-44vt8\") pod \"limitador-operator-controller-manager-5778bb4449-pk5mk\" (UID: \"10509ed9-43ef-4192-ab5e-8810571c1f5e\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"
Oct 31 07:33:15.152475 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:15.152444    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44vt8\" (UniqueName: \"kubernetes.io/projected/10509ed9-43ef-4192-ab5e-8810571c1f5e-kube-api-access-44vt8\") pod \"limitador-operator-controller-manager-5778bb4449-pk5mk\" (UID: \"10509ed9-43ef-4192-ab5e-8810571c1f5e\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"
Oct 31 07:33:15.234726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:15.234686    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"
Oct 31 07:33:15.536282 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:15.536093    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"]
Oct 31 07:33:15.541055 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:33:15.541019    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10509ed9_43ef_4192_ab5e_8810571c1f5e.slice/crio-bf20b7de643257295ac195e284e43fd075a7bde51bb3fc65c2b12e87dfa47ee1 WatchSource:0}: Error finding container bf20b7de643257295ac195e284e43fd075a7bde51bb3fc65c2b12e87dfa47ee1: Status 404 returned error can't find the container with id bf20b7de643257295ac195e284e43fd075a7bde51bb3fc65c2b12e87dfa47ee1
Oct 31 07:33:15.543438 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:15.543420    5039 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 07:33:15.733963 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:15.733905    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:16.325831 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:16.325787    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:16.394424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:16.394360    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk" event={"ID":"10509ed9-43ef-4192-ab5e-8810571c1f5e","Type":"ContainerStarted","Data":"bf20b7de643257295ac195e284e43fd075a7bde51bb3fc65c2b12e87dfa47ee1"}
Oct 31 07:33:16.931324 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:16.931270    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:17.037566 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.037530    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"]
Oct 31 07:33:17.041505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.041473    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.069951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.069205    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Oct 31 07:33:17.069951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.069299    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-95zq9\""
Oct 31 07:33:17.069951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.069355    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Oct 31 07:33:17.071721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.071678    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"]
Oct 31 07:33:17.152338 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.152294    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.152663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.152628    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.152781 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.152695    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfglk\" (UniqueName: \"kubernetes.io/projected/d3cd393e-6efc-4336-a7db-bda73492461f-kube-api-access-nfglk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.253201 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.253164    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.253383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.253221    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfglk\" (UniqueName: \"kubernetes.io/projected/d3cd393e-6efc-4336-a7db-bda73492461f-kube-api-access-nfglk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.253383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.253287    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.253622 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.253601    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.253687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.253612    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.272639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.272608    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfglk\" (UniqueName: \"kubernetes.io/projected/d3cd393e-6efc-4336-a7db-bda73492461f-kube-api-access-nfglk\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.362419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.362376    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:17.671248 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:17.671149    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"]
Oct 31 07:33:17.677806 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:33:17.677765    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cd393e_6efc_4336_a7db_bda73492461f.slice/crio-94decbbff1576c082029cca7317e0fc1d4adb49838037707e1edb27607a4359b WatchSource:0}: Error finding container 94decbbff1576c082029cca7317e0fc1d4adb49838037707e1edb27607a4359b: Status 404 returned error can't find the container with id 94decbbff1576c082029cca7317e0fc1d4adb49838037707e1edb27607a4359b
Oct 31 07:33:18.412258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:18.412135    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk" event={"ID":"10509ed9-43ef-4192-ab5e-8810571c1f5e","Type":"ContainerStarted","Data":"f12e083f9de4440130b5de1b9816b4e32be3fa01f577b2bd1481619449a154da"}
Oct 31 07:33:18.412258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:18.412244    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"
Oct 31 07:33:18.413755 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:18.413732    5039 generic.go:356] "Generic (PLEG): container finished" podID="d3cd393e-6efc-4336-a7db-bda73492461f" containerID="47c9b59ebd34be335e597c45fa91e71d3c9cf9ec63a7557c23ee2d9024ed1eac" exitCode=0
Oct 31 07:33:18.413882 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:18.413815    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l" event={"ID":"d3cd393e-6efc-4336-a7db-bda73492461f","Type":"ContainerDied","Data":"47c9b59ebd34be335e597c45fa91e71d3c9cf9ec63a7557c23ee2d9024ed1eac"}
Oct 31 07:33:18.413882 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:18.413868    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l" event={"ID":"d3cd393e-6efc-4336-a7db-bda73492461f","Type":"ContainerStarted","Data":"94decbbff1576c082029cca7317e0fc1d4adb49838037707e1edb27607a4359b"}
Oct 31 07:33:18.450060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:18.450004    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk" podStartSLOduration=1.8971331139999998 podStartE2EDuration="4.449992272s" totalImagesPullingTime="2.552859158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:33:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:33:18.44908211 +0000 UTC m=+312.978276784" watchObservedRunningTime="2026-10-31 07:33:18.449992272 +0000 UTC m=+312.979186945"
Oct 31 07:33:19.425179 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:19.425144    5039 generic.go:356] "Generic (PLEG): container finished" podID="d3cd393e-6efc-4336-a7db-bda73492461f" containerID="bea9373da85b2289ffc8f412350f7e163e3ee4bca48a1416ea8214ee6e2784af" exitCode=0
Oct 31 07:33:19.425620 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:19.425227    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l" event={"ID":"d3cd393e-6efc-4336-a7db-bda73492461f","Type":"ContainerDied","Data":"bea9373da85b2289ffc8f412350f7e163e3ee4bca48a1416ea8214ee6e2784af"}
Oct 31 07:33:20.060014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.059965    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"]
Oct 31 07:33:20.063544 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.063516    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:20.074124 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.074093    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"]
Oct 31 07:33:20.084455 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.084422    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xkk64\""
Oct 31 07:33:20.178093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.178054    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7eb917e-8e97-4a1c-9413-d023d8f50c35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pp6nz\" (UID: \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:20.178093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.178104    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj78r\" (UniqueName: \"kubernetes.io/projected/e7eb917e-8e97-4a1c-9413-d023d8f50c35-kube-api-access-lj78r\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pp6nz\" (UID: \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:20.279540 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.279493    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7eb917e-8e97-4a1c-9413-d023d8f50c35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pp6nz\" (UID: \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:20.279735 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.279547    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj78r\" (UniqueName: \"kubernetes.io/projected/e7eb917e-8e97-4a1c-9413-d023d8f50c35-kube-api-access-lj78r\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pp6nz\" (UID: \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:20.279954 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.279906    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7eb917e-8e97-4a1c-9413-d023d8f50c35-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pp6nz\" (UID: \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:20.298860 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.298829    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj78r\" (UniqueName: \"kubernetes.io/projected/e7eb917e-8e97-4a1c-9413-d023d8f50c35-kube-api-access-lj78r\") pod \"kuadrant-operator-controller-manager-cf8469d7b-pp6nz\" (UID: \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:20.377168 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.377066    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:20.441785 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.441744    5039 generic.go:356] "Generic (PLEG): container finished" podID="d3cd393e-6efc-4336-a7db-bda73492461f" containerID="38acd5d0fcabd2c42baed67692b6f69ff721d35ceb496d58d277b4a5edbe1086" exitCode=0
Oct 31 07:33:20.442193 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.441824    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l" event={"ID":"d3cd393e-6efc-4336-a7db-bda73492461f","Type":"ContainerDied","Data":"38acd5d0fcabd2c42baed67692b6f69ff721d35ceb496d58d277b4a5edbe1086"}
Oct 31 07:33:20.702198 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.702097    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"]
Oct 31 07:33:20.706708 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:33:20.706672    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7eb917e_8e97_4a1c_9413_d023d8f50c35.slice/crio-2cfe60a071160c07c7b145f2f4157e3dcad8ad789d4c02a310aeddf5b9d11349 WatchSource:0}: Error finding container 2cfe60a071160c07c7b145f2f4157e3dcad8ad789d4c02a310aeddf5b9d11349: Status 404 returned error can't find the container with id 2cfe60a071160c07c7b145f2f4157e3dcad8ad789d4c02a310aeddf5b9d11349
Oct 31 07:33:20.742552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.742493    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:20.961971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:20.961905    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:21.449283 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.449177    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz" event={"ID":"e7eb917e-8e97-4a1c-9413-d023d8f50c35","Type":"ContainerStarted","Data":"2cfe60a071160c07c7b145f2f4157e3dcad8ad789d4c02a310aeddf5b9d11349"}
Oct 31 07:33:21.608020 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.607986    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:21.692962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.692924    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-bundle\") pod \"d3cd393e-6efc-4336-a7db-bda73492461f\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") "
Oct 31 07:33:21.693140 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.693001    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3cd393e-6efc-4336-a7db-bda73492461f-kube-api-access-nfglk\" (UniqueName: \"kubernetes.io/projected/d3cd393e-6efc-4336-a7db-bda73492461f-kube-api-access-nfglk\") pod \"d3cd393e-6efc-4336-a7db-bda73492461f\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") "
Oct 31 07:33:21.693140 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.693025    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-util\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-util\") pod \"d3cd393e-6efc-4336-a7db-bda73492461f\" (UID: \"d3cd393e-6efc-4336-a7db-bda73492461f\") "
Oct 31 07:33:21.693779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.693745    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-bundle" pod "d3cd393e-6efc-4336-a7db-bda73492461f" (UID: "d3cd393e-6efc-4336-a7db-bda73492461f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:21.695593 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.695566    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3cd393e-6efc-4336-a7db-bda73492461f-kube-api-access-nfglk" pod "d3cd393e-6efc-4336-a7db-bda73492461f" (UID: "d3cd393e-6efc-4336-a7db-bda73492461f"). InnerVolumeSpecName "kube-api-access-nfglk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:33:21.702731 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.702636    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-util" pod "d3cd393e-6efc-4336-a7db-bda73492461f" (UID: "d3cd393e-6efc-4336-a7db-bda73492461f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:21.794230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.794189    5039 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:21.794230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.794221    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfglk\" (UniqueName: \"kubernetes.io/projected/d3cd393e-6efc-4336-a7db-bda73492461f-kube-api-access-nfglk\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:21.794230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:21.794232    5039 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3cd393e-6efc-4336-a7db-bda73492461f-util\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:22.255533 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.255470    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"]
Oct 31 07:33:22.255894 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.255874    5039 cpu_manager.go:414] "containerMap: removing container" podUID="d3cd393e-6efc-4336-a7db-bda73492461f" containerName="pull"
Oct 31 07:33:22.255894 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.255892    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3cd393e-6efc-4336-a7db-bda73492461f" containerName="pull"
Oct 31 07:33:22.256092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.255910    5039 cpu_manager.go:414] "containerMap: removing container" podUID="d3cd393e-6efc-4336-a7db-bda73492461f" containerName="util"
Oct 31 07:33:22.256092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.255932    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3cd393e-6efc-4336-a7db-bda73492461f" containerName="util"
Oct 31 07:33:22.256092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.255945    5039 cpu_manager.go:414] "containerMap: removing container" podUID="d3cd393e-6efc-4336-a7db-bda73492461f" containerName="extract"
Oct 31 07:33:22.256092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.255950    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3cd393e-6efc-4336-a7db-bda73492461f" containerName="extract"
Oct 31 07:33:22.256092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.256020    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3cd393e-6efc-4336-a7db-bda73492461f" containerName="extract"
Oct 31 07:33:22.259131 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.259113    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"
Oct 31 07:33:22.278549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.278515    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2zzrp\""
Oct 31 07:33:22.290549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.290487    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Oct 31 07:33:22.292825 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.292792    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"]
Oct 31 07:33:22.385700 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.385659    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:22.398808 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.398766    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hgj7\" (UniqueName: \"kubernetes.io/projected/f98ac879-e396-47a6-8c2e-52de86730d92-kube-api-access-5hgj7\") pod \"dns-operator-controller-manager-8557cbdb84-m6lgz\" (UID: \"f98ac879-e396-47a6-8c2e-52de86730d92\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"
Oct 31 07:33:22.458120 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.458088    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l"
Oct 31 07:33:22.458500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.458116    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71qtk6l" event={"ID":"d3cd393e-6efc-4336-a7db-bda73492461f","Type":"ContainerDied","Data":"94decbbff1576c082029cca7317e0fc1d4adb49838037707e1edb27607a4359b"}
Oct 31 07:33:22.458500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.458179    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94decbbff1576c082029cca7317e0fc1d4adb49838037707e1edb27607a4359b"
Oct 31 07:33:22.499470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.499426    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hgj7\" (UniqueName: \"kubernetes.io/projected/f98ac879-e396-47a6-8c2e-52de86730d92-kube-api-access-5hgj7\") pod \"dns-operator-controller-manager-8557cbdb84-m6lgz\" (UID: \"f98ac879-e396-47a6-8c2e-52de86730d92\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"
Oct 31 07:33:22.535391 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.535313    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hgj7\" (UniqueName: \"kubernetes.io/projected/f98ac879-e396-47a6-8c2e-52de86730d92-kube-api-access-5hgj7\") pod \"dns-operator-controller-manager-8557cbdb84-m6lgz\" (UID: \"f98ac879-e396-47a6-8c2e-52de86730d92\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"
Oct 31 07:33:22.571755 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.571708    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"
Oct 31 07:33:22.574637 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.574603    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:22.873466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:22.873369    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"]
Oct 31 07:33:22.878551 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:33:22.878512    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf98ac879_e396_47a6_8c2e_52de86730d92.slice/crio-5f80c390367015a7a85eac0b9978ed951d4185539967b277275541982ddb1502 WatchSource:0}: Error finding container 5f80c390367015a7a85eac0b9978ed951d4185539967b277275541982ddb1502: Status 404 returned error can't find the container with id 5f80c390367015a7a85eac0b9978ed951d4185539967b277275541982ddb1502
Oct 31 07:33:23.127347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:23.127260    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:23.462811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:23.462773    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:23.465897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:23.465860    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz" event={"ID":"f98ac879-e396-47a6-8c2e-52de86730d92","Type":"ContainerStarted","Data":"5f80c390367015a7a85eac0b9978ed951d4185539967b277275541982ddb1502"}
Oct 31 07:33:23.587721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:23.587646    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:25.273157 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.273115    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"]
Oct 31 07:33:25.295704 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.295662    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"
Oct 31 07:33:25.310200 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.310167    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"]
Oct 31 07:33:25.317868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.317816    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zsvz7\""
Oct 31 07:33:25.372021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.371974    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:25.429412 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.429375    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rzc8\" (UniqueName: \"kubernetes.io/projected/f0af3ad7-81bf-4c14-8804-c19890d0c3e4-kube-api-access-9rzc8\") pod \"authorino-operator-7b7bb4bc77-qqmkf\" (UID: \"f0af3ad7-81bf-4c14-8804-c19890d0c3e4\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"
Oct 31 07:33:25.477945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.477887    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz" event={"ID":"f98ac879-e396-47a6-8c2e-52de86730d92","Type":"ContainerStarted","Data":"8d9b872c8f961a121a4473f7477592119aaf814846ae270fcb979b5fdd8e2262"}
Oct 31 07:33:25.478122 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.477977    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"
Oct 31 07:33:25.500947 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.500887    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:25.522614 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.522544    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz" podStartSLOduration=1.869327013 podStartE2EDuration="3.522526975s" totalImagesPullingTime="1.653199962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:33:25.52036079 +0000 UTC m=+320.049555466" watchObservedRunningTime="2026-10-31 07:33:25.522526975 +0000 UTC m=+320.051721649"
Oct 31 07:33:25.530235 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.530161    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rzc8\" (UniqueName: \"kubernetes.io/projected/f0af3ad7-81bf-4c14-8804-c19890d0c3e4-kube-api-access-9rzc8\") pod \"authorino-operator-7b7bb4bc77-qqmkf\" (UID: \"f0af3ad7-81bf-4c14-8804-c19890d0c3e4\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"
Oct 31 07:33:25.549495 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.549465    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rzc8\" (UniqueName: \"kubernetes.io/projected/f0af3ad7-81bf-4c14-8804-c19890d0c3e4-kube-api-access-9rzc8\") pod \"authorino-operator-7b7bb4bc77-qqmkf\" (UID: \"f0af3ad7-81bf-4c14-8804-c19890d0c3e4\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"
Oct 31 07:33:25.628484 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:25.628450    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"
Oct 31 07:33:26.178012 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:26.177900    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"]
Oct 31 07:33:26.182467 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:33:26.182437    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0af3ad7_81bf_4c14_8804_c19890d0c3e4.slice/crio-1f03c0b171d268a3ac23b77c467fd758e1138f2eeb3b852d4bb13cd39f7d0a30 WatchSource:0}: Error finding container 1f03c0b171d268a3ac23b77c467fd758e1138f2eeb3b852d4bb13cd39f7d0a30: Status 404 returned error can't find the container with id 1f03c0b171d268a3ac23b77c467fd758e1138f2eeb3b852d4bb13cd39f7d0a30
Oct 31 07:33:26.484680 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:26.484641    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf" event={"ID":"f0af3ad7-81bf-4c14-8804-c19890d0c3e4","Type":"ContainerStarted","Data":"1f03c0b171d268a3ac23b77c467fd758e1138f2eeb3b852d4bb13cd39f7d0a30"}
Oct 31 07:33:26.486395 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:26.486369    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz" event={"ID":"e7eb917e-8e97-4a1c-9413-d023d8f50c35","Type":"ContainerStarted","Data":"e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b"}
Oct 31 07:33:26.486474 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:26.486456    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:26.536151 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:26.536094    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz" podStartSLOduration=1.343444676 podStartE2EDuration="6.536080114s" totalImagesPullingTime="5.192635438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:33:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:33:26.535630542 +0000 UTC m=+321.064825216" watchObservedRunningTime="2026-10-31 07:33:26.536080114 +0000 UTC m=+321.065274788"
Oct 31 07:33:26.779344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:26.779236    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:26.890588 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:26.890557    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:27.732862 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:27.732811    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:27.844596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:27.844557    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:28.498258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:28.498216    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf" event={"ID":"f0af3ad7-81bf-4c14-8804-c19890d0c3e4","Type":"ContainerStarted","Data":"bb4e2fb15d15f3e5168934c0823b6d51151e60bd72966a46fbe323cce948657c"}
Oct 31 07:33:28.498444 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:28.498315    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"
Oct 31 07:33:28.537505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:28.537453    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf" podStartSLOduration=1.86175337 podStartE2EDuration="3.537440117s" totalImagesPullingTime="1.675686747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:33:28.536713042 +0000 UTC m=+323.065907716" watchObservedRunningTime="2026-10-31 07:33:28.537440117 +0000 UTC m=+323.066634792"
Oct 31 07:33:28.696619 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:33:28.696579    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:33:29.139398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:29.139365    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:29.338573 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:29.338535    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:29.428423 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:29.428342    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-pk5mk"
Oct 31 07:33:29.447897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:29.447864    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:29.571270 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:29.571230    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:30.805624 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.805590    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:30.924737 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.924663    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"]
Oct 31 07:33:30.928478 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.928452    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:30.943173 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.943136    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 31 07:33:30.943361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.943228    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 31 07:33:30.955029 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.954995    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 31 07:33:30.955253 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.955233    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 31 07:33:30.955337 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.955260    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-4qjz7\""
Oct 31 07:33:30.955337 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.955271    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 31 07:33:30.970020 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:30.969970    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"]
Oct 31 07:33:31.081897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.081803    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3574328-5b1f-4a37-b939-8501022f9972-metrics-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.081897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.081849    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3574328-5b1f-4a37-b939-8501022f9972-tmp\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.082115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.081962    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3574328-5b1f-4a37-b939-8501022f9972-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.082115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.082010    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3574328-5b1f-4a37-b939-8501022f9972-manifests\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.082115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.082074    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3574328-5b1f-4a37-b939-8501022f9972-webhook-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.082217 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.082127    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfxdh\" (UniqueName: \"kubernetes.io/projected/e3574328-5b1f-4a37-b939-8501022f9972-kube-api-access-wfxdh\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.102677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.102648    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:31.183310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.183275    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3574328-5b1f-4a37-b939-8501022f9972-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.183310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.183318    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3574328-5b1f-4a37-b939-8501022f9972-manifests\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.183543 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.183337    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3574328-5b1f-4a37-b939-8501022f9972-webhook-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.183543 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.183370    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfxdh\" (UniqueName: \"kubernetes.io/projected/e3574328-5b1f-4a37-b939-8501022f9972-kube-api-access-wfxdh\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.183543 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.183409    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3574328-5b1f-4a37-b939-8501022f9972-metrics-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.183543 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.183434    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3574328-5b1f-4a37-b939-8501022f9972-tmp\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.183797 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.183770    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3574328-5b1f-4a37-b939-8501022f9972-manifests\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.185880 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.185846    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3574328-5b1f-4a37-b939-8501022f9972-tmp\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.186037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.185974    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3574328-5b1f-4a37-b939-8501022f9972-metrics-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.186327 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.186306    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3574328-5b1f-4a37-b939-8501022f9972-webhook-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.186409 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.186337    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3574328-5b1f-4a37-b939-8501022f9972-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.208006 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.207976    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfxdh\" (UniqueName: \"kubernetes.io/projected/e3574328-5b1f-4a37-b939-8501022f9972-kube-api-access-wfxdh\") pod \"opendatahub-operator-controller-manager-6476fc869f-j728c\" (UID: \"e3574328-5b1f-4a37-b939-8501022f9972\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.224266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.224234    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:31.244261 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.244227    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:31.398627 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.398537    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:31.513542 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.513503    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:31.621326 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.621292    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"]
Oct 31 07:33:31.635060 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:33:31.635031    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3574328_5b1f_4a37_b939_8501022f9972.slice/crio-ad476aa9c847b076c35888e849672821458d657532c20748b001aaab678f9a5b WatchSource:0}: Error finding container ad476aa9c847b076c35888e849672821458d657532c20748b001aaab678f9a5b: Status 404 returned error can't find the container with id ad476aa9c847b076c35888e849672821458d657532c20748b001aaab678f9a5b
Oct 31 07:33:31.639861 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:31.639831    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:32.521766 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:32.521729    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c" event={"ID":"e3574328-5b1f-4a37-b939-8501022f9972","Type":"ContainerStarted","Data":"ad476aa9c847b076c35888e849672821458d657532c20748b001aaab678f9a5b"}
Oct 31 07:33:33.281331 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:33.281271    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:33.396145 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:33.396109    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:33.731985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:33.731945    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:33.843603 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:33.843568    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:34.534074 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:34.534028    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c" event={"ID":"e3574328-5b1f-4a37-b939-8501022f9972","Type":"ContainerStarted","Data":"a9722974a63b08c57cfe49a0c72361b503808dc31441bcf4984c6f46b703053b"}
Oct 31 07:33:34.557677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:34.557640    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:34.755429 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:34.755394    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:34.878657 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:34.878624    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:35.343538 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:35.343444    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:35.469341 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:35.469302    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:35.541072 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:35.541041    5039 generic.go:356] "Generic (PLEG): container finished" podID="e3574328-5b1f-4a37-b939-8501022f9972" containerID="a9722974a63b08c57cfe49a0c72361b503808dc31441bcf4984c6f46b703053b" exitCode=0
Oct 31 07:33:35.541253 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:35.541129    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c" event={"ID":"e3574328-5b1f-4a37-b939-8501022f9972","Type":"ContainerDied","Data":"a9722974a63b08c57cfe49a0c72361b503808dc31441bcf4984c6f46b703053b"}
Oct 31 07:33:36.489699 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:36.489666    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-m6lgz"
Oct 31 07:33:36.550092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:36.550042    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c" event={"ID":"e3574328-5b1f-4a37-b939-8501022f9972","Type":"ContainerStarted","Data":"f3588ceeacb3c4ff3ed4fe38b8ba90d233200331d285c6a6892a0f187d915105"}
Oct 31 07:33:36.550278 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:36.550258    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:36.635335 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:36.635284    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c" podStartSLOduration=2.93095021 podStartE2EDuration="6.635270352s" totalImagesPullingTime="3.174851265s" totalInitContainerRuntime="529.468877ms" isStatefulPod=false podCreationTimestamp="2026-10-31 07:33:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:33:36.623817873 +0000 UTC m=+331.153012548" watchObservedRunningTime="2026-10-31 07:33:36.635270352 +0000 UTC m=+331.164465026"
Oct 31 07:33:37.494666 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:37.494629    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:39.355045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:39.355009    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:39.465551 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:39.465518    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:39.506443 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:39.506410    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-qqmkf"
Oct 31 07:33:43.133592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:43.133559    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:43.246053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:43.245984    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:45.118478 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:45.118440    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:45.237278 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:45.237227    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:46.605843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:46.605807    5039 generic.go:356] "Generic (PLEG): container finished" podID="e3574328-5b1f-4a37-b939-8501022f9972" containerID="f3588ceeacb3c4ff3ed4fe38b8ba90d233200331d285c6a6892a0f187d915105" exitCode=1
Oct 31 07:33:46.606258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:46.605879    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c" event={"ID":"e3574328-5b1f-4a37-b939-8501022f9972","Type":"ContainerDied","Data":"f3588ceeacb3c4ff3ed4fe38b8ba90d233200331d285c6a6892a0f187d915105"}
Oct 31 07:33:46.606349 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:46.606334    5039 scope.go:122] "RemoveContainer" containerID="f3588ceeacb3c4ff3ed4fe38b8ba90d233200331d285c6a6892a0f187d915105"
Oct 31 07:33:47.615196 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:47.615161    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c" event={"ID":"e3574328-5b1f-4a37-b939-8501022f9972","Type":"ContainerStarted","Data":"42bbb76c74e1e83cf433798c44bed85d03a56c638d4897ad2081d4a28ca16e74"}
Oct 31 07:33:47.615611 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:47.615476    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:48.566705 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:48.566663    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:48.686547 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:48.686510    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:51.149873 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:51.149832    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:51.276346 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:51.276309    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:54.770771 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:54.770735    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"]
Oct 31 07:33:54.771266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:54.771017    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz" podUID="e7eb917e-8e97-4a1c-9413-d023d8f50c35" containerName="manager" containerID="cri-o://e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b" gracePeriod=10
Oct 31 07:33:54.936713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:54.936678    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:55.022479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.022420    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:55.052326 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.052291    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:55.104408 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.104371    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7eb917e-8e97-4a1c-9413-d023d8f50c35-kube-api-access-lj78r\" (UniqueName: \"kubernetes.io/projected/e7eb917e-8e97-4a1c-9413-d023d8f50c35-kube-api-access-lj78r\") pod \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\" (UID: \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\") "
Oct 31 07:33:55.104564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.104451    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7eb917e-8e97-4a1c-9413-d023d8f50c35-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7eb917e-8e97-4a1c-9413-d023d8f50c35-extensions-socket-volume\") pod \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\" (UID: \"e7eb917e-8e97-4a1c-9413-d023d8f50c35\") "
Oct 31 07:33:55.104950 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.104900    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7eb917e-8e97-4a1c-9413-d023d8f50c35-extensions-socket-volume" pod "e7eb917e-8e97-4a1c-9413-d023d8f50c35" (UID: "e7eb917e-8e97-4a1c-9413-d023d8f50c35"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:33:55.106615 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.106590    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7eb917e-8e97-4a1c-9413-d023d8f50c35-kube-api-access-lj78r" pod "e7eb917e-8e97-4a1c-9413-d023d8f50c35" (UID: "e7eb917e-8e97-4a1c-9413-d023d8f50c35"). InnerVolumeSpecName "kube-api-access-lj78r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:33:55.205497 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.205456    5039 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e7eb917e-8e97-4a1c-9413-d023d8f50c35-extensions-socket-volume\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:55.205497 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.205488    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj78r\" (UniqueName: \"kubernetes.io/projected/e7eb917e-8e97-4a1c-9413-d023d8f50c35-kube-api-access-lj78r\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:33:55.223824 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.223791    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:55.654472 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.654432    5039 generic.go:356] "Generic (PLEG): container finished" podID="e7eb917e-8e97-4a1c-9413-d023d8f50c35" containerID="e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b" exitCode=0
Oct 31 07:33:55.654631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.654489    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz" event={"ID":"e7eb917e-8e97-4a1c-9413-d023d8f50c35","Type":"ContainerDied","Data":"e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b"}
Oct 31 07:33:55.654631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.654492    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"
Oct 31 07:33:55.654631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.654528    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz" event={"ID":"e7eb917e-8e97-4a1c-9413-d023d8f50c35","Type":"ContainerDied","Data":"2cfe60a071160c07c7b145f2f4157e3dcad8ad789d4c02a310aeddf5b9d11349"}
Oct 31 07:33:55.654631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.654548    5039 scope.go:122] "RemoveContainer" containerID="e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b"
Oct 31 07:33:55.663618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.663595    5039 scope.go:122] "RemoveContainer" containerID="e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b"
Oct 31 07:33:55.663888 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:33:55.663864    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b\": container with ID starting with e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b not found: ID does not exist" containerID="e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b"
Oct 31 07:33:55.663946 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.663898    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b"} err="failed to get container status \"e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b\": rpc error: code = NotFound desc = could not find container \"e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b\": container with ID starting with e8b0bf860fd745f235bd23515b28030806a61db825ea69f8edcf2f938245405b not found: ID does not exist"
Oct 31 07:33:55.672551 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.672530    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:55.715977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.715940    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"]
Oct 31 07:33:55.727554 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:55.727524    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-pp6nz"]
Oct 31 07:33:56.191550 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:56.191519    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:56.318283 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:56.318241    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:33:57.614359 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:57.614326    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7eb917e-8e97-4a1c-9413-d023d8f50c35" path="/var/lib/kubelet/pods/e7eb917e-8e97-4a1c-9413-d023d8f50c35/volumes"
Oct 31 07:33:58.623277 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:33:58.623245    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-6476fc869f-j728c"
Oct 31 07:33:58.696463 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:33:58.696424    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:34:00.553436 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:00.553391    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:02.988756 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:02.988706    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:03.088728 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:03.088687    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:05.652266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:05.652230    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:07.708217 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:07.708177    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:07.812787 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:07.812729    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:09.545844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:09.545803    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:09.685845 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:09.685784    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:11.484239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:11.484198    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:11.599609 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:11.599560    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:11.846481 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:11.846384    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:12.133358 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.133276    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:12.255483 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.255425    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"]
Oct 31 07:34:12.255954 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.255933    5039 cpu_manager.go:414] "containerMap: removing container" podUID="e7eb917e-8e97-4a1c-9413-d023d8f50c35" containerName="manager"
Oct 31 07:34:12.255954 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.255955    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7eb917e-8e97-4a1c-9413-d023d8f50c35" containerName="manager"
Oct 31 07:34:12.256140 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.256065    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7eb917e-8e97-4a1c-9413-d023d8f50c35" containerName="manager"
Oct 31 07:34:12.265489 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.265459    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.292234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.292203    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-nzldp\""
Oct 31 07:34:12.295564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.295527    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"]
Oct 31 07:34:12.301748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.301714    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:12.356747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.356698    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.356957 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.356761    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.356957 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.356845    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c466db13-469b-488f-bf26-5229a2bcbb49-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.356957 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.356936    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c466db13-469b-488f-bf26-5229a2bcbb49-istio-token\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.357138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.357027    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.357138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.357081    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c466db13-469b-488f-bf26-5229a2bcbb49-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.357221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.357148    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqhl6\" (UniqueName: \"kubernetes.io/projected/c466db13-469b-488f-bf26-5229a2bcbb49-kube-api-access-pqhl6\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.357221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.357180    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.357221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.357197    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-istio-data\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.427097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.427001    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:12.457774 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.457737    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.457774 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.457773    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-istio-data\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458035 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.457903    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458035 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.457987    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458035 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.458007    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c466db13-469b-488f-bf26-5229a2bcbb49-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.458051    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c466db13-469b-488f-bf26-5229a2bcbb49-istio-token\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.458087    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.458139    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c466db13-469b-488f-bf26-5229a2bcbb49-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.458175    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqhl6\" (UniqueName: \"kubernetes.io/projected/c466db13-469b-488f-bf26-5229a2bcbb49-kube-api-access-pqhl6\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.458333    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.458355    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458540 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.458490    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-istio-data\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.458596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.458534    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.459026 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.459004    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c466db13-469b-488f-bf26-5229a2bcbb49-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.460442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.460415    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c466db13-469b-488f-bf26-5229a2bcbb49-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.460589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.460572    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c466db13-469b-488f-bf26-5229a2bcbb49-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.476689 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.476654    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c466db13-469b-488f-bf26-5229a2bcbb49-istio-token\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.476848 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.476749    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqhl6\" (UniqueName: \"kubernetes.io/projected/c466db13-469b-488f-bf26-5229a2bcbb49-kube-api-access-pqhl6\") pod \"data-science-gateway-data-science-gateway-class-848cd468bf6xwgj\" (UID: \"c466db13-469b-488f-bf26-5229a2bcbb49\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.579672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.579632    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:12.619765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.619726    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:12.883226 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.883174    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:12.894988 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.894959    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"]
Oct 31 07:34:12.899710 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:34:12.899680    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc466db13_469b_488f_bf26_5229a2bcbb49.slice/crio-7f87745336f0761f679fe4660a3c63d5e5588e394e2c5317faaec35c8b253d29 WatchSource:0}: Error finding container 7f87745336f0761f679fe4660a3c63d5e5588e394e2c5317faaec35c8b253d29: Status 404 returned error can't find the container with id 7f87745336f0761f679fe4660a3c63d5e5588e394e2c5317faaec35c8b253d29
Oct 31 07:34:12.901811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.901778    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:34:12.901874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.901850    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:34:12.901924 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.901881    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:34:12.992594 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:12.992550    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:13.100413 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.100370    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"]
Oct 31 07:34:13.104392 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.104369    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:13.119900 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.119874    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jrdcs\""
Oct 31 07:34:13.119900 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.119874    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 31 07:34:13.128901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.123310    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"]
Oct 31 07:34:13.128901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.126929    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:13.240734 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.240698    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"]
Oct 31 07:34:13.257583 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.257542    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:13.264499 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.264470    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zq8t\" (UniqueName: \"kubernetes.io/projected/00d7a15f-2645-420b-9f4a-5f5e04d33db7-kube-api-access-2zq8t\") pod \"limitador-limitador-74dfcfb894-6ztw8\" (UID: \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:13.264645 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.264524    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00d7a15f-2645-420b-9f4a-5f5e04d33db7-config-file\") pod \"limitador-limitador-74dfcfb894-6ztw8\" (UID: \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:13.365850 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.365808    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00d7a15f-2645-420b-9f4a-5f5e04d33db7-config-file\") pod \"limitador-limitador-74dfcfb894-6ztw8\" (UID: \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:13.366045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.365886    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zq8t\" (UniqueName: \"kubernetes.io/projected/00d7a15f-2645-420b-9f4a-5f5e04d33db7-kube-api-access-2zq8t\") pod \"limitador-limitador-74dfcfb894-6ztw8\" (UID: \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:13.366519 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.366496    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00d7a15f-2645-420b-9f4a-5f5e04d33db7-config-file\") pod \"limitador-limitador-74dfcfb894-6ztw8\" (UID: \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:13.385603 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.385567    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zq8t\" (UniqueName: \"kubernetes.io/projected/00d7a15f-2645-420b-9f4a-5f5e04d33db7-kube-api-access-2zq8t\") pod \"limitador-limitador-74dfcfb894-6ztw8\" (UID: \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:13.386049 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.386026    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:13.420846 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.420817    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:13.719075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.718993    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"]
Oct 31 07:34:13.723551 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:34:13.723511    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d7a15f_2645_420b_9f4a_5f5e04d33db7.slice/crio-5e7487937d342350756d19609cb3a7318ec3adbd35d8a6cfdb87afda3734de8e WatchSource:0}: Error finding container 5e7487937d342350756d19609cb3a7318ec3adbd35d8a6cfdb87afda3734de8e: Status 404 returned error can't find the container with id 5e7487937d342350756d19609cb3a7318ec3adbd35d8a6cfdb87afda3734de8e
Oct 31 07:34:13.749885 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.749844    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8" event={"ID":"00d7a15f-2645-420b-9f4a-5f5e04d33db7","Type":"ContainerStarted","Data":"5e7487937d342350756d19609cb3a7318ec3adbd35d8a6cfdb87afda3734de8e"}
Oct 31 07:34:13.751499 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.751464    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj" event={"ID":"c466db13-469b-488f-bf26-5229a2bcbb49","Type":"ContainerStarted","Data":"b2f9f3a1251b6aa12adb23d1e0a32ec11443b4ffcf11256f49ede015eb3b3b7c"}
Oct 31 07:34:13.751607 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.751518    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj" event={"ID":"c466db13-469b-488f-bf26-5229a2bcbb49","Type":"ContainerStarted","Data":"7f87745336f0761f679fe4660a3c63d5e5588e394e2c5317faaec35c8b253d29"}
Oct 31 07:34:13.793265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:13.793198    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj" podStartSLOduration=1.7931768369999999 podStartE2EDuration="1.793176837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:13.790723261 +0000 UTC m=+368.319917935" watchObservedRunningTime="2026-10-31 07:34:13.793176837 +0000 UTC m=+368.322371512"
Oct 31 07:34:14.133768 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.133664    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-mhbkh"]
Oct 31 07:34:14.138985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.138963    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-mhbkh"
Oct 31 07:34:14.153150 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.153117    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-r96cl\""
Oct 31 07:34:14.153837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.153809    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-mhbkh"]
Oct 31 07:34:14.273871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.273829    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnts8\" (UniqueName: \"kubernetes.io/projected/5e8125ce-2361-4da4-9e2f-5dd4ed732a1c-kube-api-access-fnts8\") pod \"authorino-57f7f8659f-mhbkh\" (UID: \"5e8125ce-2361-4da4-9e2f-5dd4ed732a1c\") " pod="kuadrant-system/authorino-57f7f8659f-mhbkh"
Oct 31 07:34:14.287365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.287333    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:14.375397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.375364    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnts8\" (UniqueName: \"kubernetes.io/projected/5e8125ce-2361-4da4-9e2f-5dd4ed732a1c-kube-api-access-fnts8\") pod \"authorino-57f7f8659f-mhbkh\" (UID: \"5e8125ce-2361-4da4-9e2f-5dd4ed732a1c\") " pod="kuadrant-system/authorino-57f7f8659f-mhbkh"
Oct 31 07:34:14.394500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.394427    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnts8\" (UniqueName: \"kubernetes.io/projected/5e8125ce-2361-4da4-9e2f-5dd4ed732a1c-kube-api-access-fnts8\") pod \"authorino-57f7f8659f-mhbkh\" (UID: \"5e8125ce-2361-4da4-9e2f-5dd4ed732a1c\") " pod="kuadrant-system/authorino-57f7f8659f-mhbkh"
Oct 31 07:34:14.402111 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.402084    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:14.451865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.451826    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-mhbkh"
Oct 31 07:34:14.516332 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.516307    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:14.580703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.580664    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:14.585667 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.585635    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:14.750488 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.750409    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-mhbkh"]
Oct 31 07:34:14.755828 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:34:14.755799    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e8125ce_2361_4da4_9e2f_5dd4ed732a1c.slice/crio-662e06f444f705aed461781e91c9c682f2ce5b689db161f9b15ddced40ad3dfd WatchSource:0}: Error finding container 662e06f444f705aed461781e91c9c682f2ce5b689db161f9b15ddced40ad3dfd: Status 404 returned error can't find the container with id 662e06f444f705aed461781e91c9c682f2ce5b689db161f9b15ddced40ad3dfd
Oct 31 07:34:14.759383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.759357    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:14.760378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.760354    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-848cd468bf6xwgj"
Oct 31 07:34:14.870027 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.869995    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-bl7n2"]
Oct 31 07:34:14.873945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.873903    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2"
Oct 31 07:34:14.890284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.890233    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-bl7n2"]
Oct 31 07:34:14.902290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.902218    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:14.981588 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:14.981549    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b77xp\" (UniqueName: \"kubernetes.io/projected/b0c75265-257d-42bc-9f99-018a256bf044-kube-api-access-b77xp\") pod \"authorino-56c6c9ddd5-bl7n2\" (UID: \"b0c75265-257d-42bc-9f99-018a256bf044\") " pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2"
Oct 31 07:34:15.082610 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:15.082570    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b77xp\" (UniqueName: \"kubernetes.io/projected/b0c75265-257d-42bc-9f99-018a256bf044-kube-api-access-b77xp\") pod \"authorino-56c6c9ddd5-bl7n2\" (UID: \"b0c75265-257d-42bc-9f99-018a256bf044\") " pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2"
Oct 31 07:34:15.101423 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:15.101394    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b77xp\" (UniqueName: \"kubernetes.io/projected/b0c75265-257d-42bc-9f99-018a256bf044-kube-api-access-b77xp\") pod \"authorino-56c6c9ddd5-bl7n2\" (UID: \"b0c75265-257d-42bc-9f99-018a256bf044\") " pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2"
Oct 31 07:34:15.188044 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:15.188011    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2"
Oct 31 07:34:15.482962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:15.482900    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-bl7n2"]
Oct 31 07:34:15.487929 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:34:15.487887    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0c75265_257d_42bc_9f99_018a256bf044.slice/crio-326a0fa9446efd5420ce8b5996c721e429cffa39f49b246542be83f003e97353 WatchSource:0}: Error finding container 326a0fa9446efd5420ce8b5996c721e429cffa39f49b246542be83f003e97353: Status 404 returned error can't find the container with id 326a0fa9446efd5420ce8b5996c721e429cffa39f49b246542be83f003e97353
Oct 31 07:34:15.766736 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:15.766646    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-mhbkh" event={"ID":"5e8125ce-2361-4da4-9e2f-5dd4ed732a1c","Type":"ContainerStarted","Data":"662e06f444f705aed461781e91c9c682f2ce5b689db161f9b15ddced40ad3dfd"}
Oct 31 07:34:15.768580 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:15.768549    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2" event={"ID":"b0c75265-257d-42bc-9f99-018a256bf044","Type":"ContainerStarted","Data":"326a0fa9446efd5420ce8b5996c721e429cffa39f49b246542be83f003e97353"}
Oct 31 07:34:15.770660 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:15.770631    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8" event={"ID":"00d7a15f-2645-420b-9f4a-5f5e04d33db7","Type":"ContainerStarted","Data":"3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1"}
Oct 31 07:34:15.770939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:15.770895    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:15.810032 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:15.809233    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8" podStartSLOduration=1.4844114560000001 podStartE2EDuration="2.809217679s" totalImagesPullingTime="1.324806223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:15.806503046 +0000 UTC m=+370.335697722" watchObservedRunningTime="2026-10-31 07:34:15.809217679 +0000 UTC m=+370.338412353"
Oct 31 07:34:17.783508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:17.783460    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-mhbkh" event={"ID":"5e8125ce-2361-4da4-9e2f-5dd4ed732a1c","Type":"ContainerStarted","Data":"b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc"}
Oct 31 07:34:17.785163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:17.785133    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2" event={"ID":"b0c75265-257d-42bc-9f99-018a256bf044","Type":"ContainerStarted","Data":"abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3"}
Oct 31 07:34:17.820508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:17.820452    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-mhbkh" podStartSLOduration=1.638719267 podStartE2EDuration="3.820438078s" totalImagesPullingTime="2.181718811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:17.818150645 +0000 UTC m=+372.347345319" watchObservedRunningTime="2026-10-31 07:34:17.820438078 +0000 UTC m=+372.349632751"
Oct 31 07:34:17.853504 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:17.853450    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2" podStartSLOduration=2.411826626 podStartE2EDuration="3.853436113s" totalImagesPullingTime="1.441609487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:17.851864943 +0000 UTC m=+372.381059617" watchObservedRunningTime="2026-10-31 07:34:17.853436113 +0000 UTC m=+372.382630786"
Oct 31 07:34:17.876581 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:17.876547    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-mhbkh"]
Oct 31 07:34:19.794482 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:19.794438    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-mhbkh" podUID="5e8125ce-2361-4da4-9e2f-5dd4ed732a1c" containerName="authorino" containerID="cri-o://b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc" gracePeriod=30
Oct 31 07:34:20.044422 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.044395    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-mhbkh"
Oct 31 07:34:20.129500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.129405    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5e8125ce-2361-4da4-9e2f-5dd4ed732a1c-kube-api-access-fnts8\" (UniqueName: \"kubernetes.io/projected/5e8125ce-2361-4da4-9e2f-5dd4ed732a1c-kube-api-access-fnts8\") pod \"5e8125ce-2361-4da4-9e2f-5dd4ed732a1c\" (UID: \"5e8125ce-2361-4da4-9e2f-5dd4ed732a1c\") "
Oct 31 07:34:20.131732 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.131690    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e8125ce-2361-4da4-9e2f-5dd4ed732a1c-kube-api-access-fnts8" pod "5e8125ce-2361-4da4-9e2f-5dd4ed732a1c" (UID: "5e8125ce-2361-4da4-9e2f-5dd4ed732a1c"). InnerVolumeSpecName "kube-api-access-fnts8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:34:20.231108 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.231071    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnts8\" (UniqueName: \"kubernetes.io/projected/5e8125ce-2361-4da4-9e2f-5dd4ed732a1c-kube-api-access-fnts8\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:34:20.800398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.800361    5039 generic.go:356] "Generic (PLEG): container finished" podID="5e8125ce-2361-4da4-9e2f-5dd4ed732a1c" containerID="b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc" exitCode=0
Oct 31 07:34:20.800852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.800405    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-mhbkh"
Oct 31 07:34:20.800852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.800450    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-mhbkh" event={"ID":"5e8125ce-2361-4da4-9e2f-5dd4ed732a1c","Type":"ContainerDied","Data":"b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc"}
Oct 31 07:34:20.800852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.800496    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-mhbkh" event={"ID":"5e8125ce-2361-4da4-9e2f-5dd4ed732a1c","Type":"ContainerDied","Data":"662e06f444f705aed461781e91c9c682f2ce5b689db161f9b15ddced40ad3dfd"}
Oct 31 07:34:20.800852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.800516    5039 scope.go:122] "RemoveContainer" containerID="b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc"
Oct 31 07:34:20.810224 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.810203    5039 scope.go:122] "RemoveContainer" containerID="b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc"
Oct 31 07:34:20.810497 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:34:20.810475    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc\": container with ID starting with b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc not found: ID does not exist" containerID="b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc"
Oct 31 07:34:20.810565 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.810506    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc"} err="failed to get container status \"b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc\": rpc error: code = NotFound desc = could not find container \"b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc\": container with ID starting with b960081158b5dffe3e15dc225627ce367b8eb405ef5a7ad83c63a5abfddc17cc not found: ID does not exist"
Oct 31 07:34:20.848383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.848346    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-mhbkh"]
Oct 31 07:34:20.860144 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:20.860107    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-mhbkh"]
Oct 31 07:34:21.614391 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:21.614348    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5e8125ce-2361-4da4-9e2f-5dd4ed732a1c" path="/var/lib/kubelet/pods/5e8125ce-2361-4da4-9e2f-5dd4ed732a1c/volumes"
Oct 31 07:34:26.777357 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:26.777321    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:28.493388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:28.491214    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"]
Oct 31 07:34:28.493388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:28.491578    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8" podUID="00d7a15f-2645-420b-9f4a-5f5e04d33db7" containerName="limitador" containerID="cri-o://3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1" gracePeriod=30
Oct 31 07:34:28.695739 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:34:28.695687    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:34:29.048241 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.048215    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:29.112037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.111960    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00d7a15f-2645-420b-9f4a-5f5e04d33db7-config-file\" (UniqueName: \"kubernetes.io/configmap/00d7a15f-2645-420b-9f4a-5f5e04d33db7-config-file\") pod \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\" (UID: \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\") "
Oct 31 07:34:29.112305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.112281    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00d7a15f-2645-420b-9f4a-5f5e04d33db7-config-file" pod "00d7a15f-2645-420b-9f4a-5f5e04d33db7" (UID: "00d7a15f-2645-420b-9f4a-5f5e04d33db7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:34:29.212515 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.212476    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00d7a15f-2645-420b-9f4a-5f5e04d33db7-kube-api-access-2zq8t\" (UniqueName: \"kubernetes.io/projected/00d7a15f-2645-420b-9f4a-5f5e04d33db7-kube-api-access-2zq8t\") pod \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\" (UID: \"00d7a15f-2645-420b-9f4a-5f5e04d33db7\") "
Oct 31 07:34:29.212718 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.212706    5039 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00d7a15f-2645-420b-9f4a-5f5e04d33db7-config-file\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:34:29.214606 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.214577    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00d7a15f-2645-420b-9f4a-5f5e04d33db7-kube-api-access-2zq8t" pod "00d7a15f-2645-420b-9f4a-5f5e04d33db7" (UID: "00d7a15f-2645-420b-9f4a-5f5e04d33db7"). InnerVolumeSpecName "kube-api-access-2zq8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:34:29.313111 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.313074    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zq8t\" (UniqueName: \"kubernetes.io/projected/00d7a15f-2645-420b-9f4a-5f5e04d33db7-kube-api-access-2zq8t\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:34:29.849070 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.849034    5039 generic.go:356] "Generic (PLEG): container finished" podID="00d7a15f-2645-420b-9f4a-5f5e04d33db7" containerID="3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1" exitCode=0
Oct 31 07:34:29.849725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.849083    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"
Oct 31 07:34:29.849725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.849115    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8" event={"ID":"00d7a15f-2645-420b-9f4a-5f5e04d33db7","Type":"ContainerDied","Data":"3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1"}
Oct 31 07:34:29.849725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.849185    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-6ztw8" event={"ID":"00d7a15f-2645-420b-9f4a-5f5e04d33db7","Type":"ContainerDied","Data":"5e7487937d342350756d19609cb3a7318ec3adbd35d8a6cfdb87afda3734de8e"}
Oct 31 07:34:29.849725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.849219    5039 scope.go:122] "RemoveContainer" containerID="3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1"
Oct 31 07:34:29.858437 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.858414    5039 scope.go:122] "RemoveContainer" containerID="3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1"
Oct 31 07:34:29.858776 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:34:29.858751    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1\": container with ID starting with 3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1 not found: ID does not exist" containerID="3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1"
Oct 31 07:34:29.858836 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.858788    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1"} err="failed to get container status \"3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1\": rpc error: code = NotFound desc = could not find container \"3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1\": container with ID starting with 3d170eefc950e7da4198638f94d26a2bc00b232dca2d9acdd5691734e49f40e1 not found: ID does not exist"
Oct 31 07:34:29.897162 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.897081    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"]
Oct 31 07:34:29.909023 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:29.908992    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-6ztw8"]
Oct 31 07:34:31.614580 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:31.614533    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="00d7a15f-2645-420b-9f4a-5f5e04d33db7" path="/var/lib/kubelet/pods/00d7a15f-2645-420b-9f4a-5f5e04d33db7/volumes"
Oct 31 07:34:33.871976 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:33.871941    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:33.987940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:33.987881    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:44.500855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.500816    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"]
Oct 31 07:34:44.501265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.501218    5039 cpu_manager.go:414] "containerMap: removing container" podUID="5e8125ce-2361-4da4-9e2f-5dd4ed732a1c" containerName="authorino"
Oct 31 07:34:44.501265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.501230    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5e8125ce-2361-4da4-9e2f-5dd4ed732a1c" containerName="authorino"
Oct 31 07:34:44.501265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.501254    5039 cpu_manager.go:414] "containerMap: removing container" podUID="00d7a15f-2645-420b-9f4a-5f5e04d33db7" containerName="limitador"
Oct 31 07:34:44.501265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.501258    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00d7a15f-2645-420b-9f4a-5f5e04d33db7" containerName="limitador"
Oct 31 07:34:44.501393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.501315    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="5e8125ce-2361-4da4-9e2f-5dd4ed732a1c" containerName="authorino"
Oct 31 07:34:44.501393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.501326    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="00d7a15f-2645-420b-9f4a-5f5e04d33db7" containerName="limitador"
Oct 31 07:34:44.505864 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.505843    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:44.520225 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.520186    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-ktfhx\""
Oct 31 07:34:44.521270 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.521243    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Oct 31 07:34:44.521416 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.521272    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 31 07:34:44.521416 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.521314    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 31 07:34:44.522680 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.522319    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"]
Oct 31 07:34:44.525987 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.525961    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bf86884b-19ca-402f-8ac1-1c822ffedcc6-data\") pod \"postgres-7cdbf6dc44-8fr55\" (UID: \"bf86884b-19ca-402f-8ac1-1c822ffedcc6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:44.526109 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.526022    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd5z4\" (UniqueName: \"kubernetes.io/projected/bf86884b-19ca-402f-8ac1-1c822ffedcc6-kube-api-access-nd5z4\") pod \"postgres-7cdbf6dc44-8fr55\" (UID: \"bf86884b-19ca-402f-8ac1-1c822ffedcc6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:44.609574 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.609544    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:44.627256 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.627217    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd5z4\" (UniqueName: \"kubernetes.io/projected/bf86884b-19ca-402f-8ac1-1c822ffedcc6-kube-api-access-nd5z4\") pod \"postgres-7cdbf6dc44-8fr55\" (UID: \"bf86884b-19ca-402f-8ac1-1c822ffedcc6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:44.627539 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.627523    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bf86884b-19ca-402f-8ac1-1c822ffedcc6-data\") pod \"postgres-7cdbf6dc44-8fr55\" (UID: \"bf86884b-19ca-402f-8ac1-1c822ffedcc6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:44.627888 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.627869    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bf86884b-19ca-402f-8ac1-1c822ffedcc6-data\") pod \"postgres-7cdbf6dc44-8fr55\" (UID: \"bf86884b-19ca-402f-8ac1-1c822ffedcc6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:44.646192 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.646156    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd5z4\" (UniqueName: \"kubernetes.io/projected/bf86884b-19ca-402f-8ac1-1c822ffedcc6-kube-api-access-nd5z4\") pod \"postgres-7cdbf6dc44-8fr55\" (UID: \"bf86884b-19ca-402f-8ac1-1c822ffedcc6\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:44.818733 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:44.818642    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:45.116183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:45.116102    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"]
Oct 31 07:34:45.930041 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:45.929961    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55" event={"ID":"bf86884b-19ca-402f-8ac1-1c822ffedcc6","Type":"ContainerStarted","Data":"e6727f2bb9443b1e35ccd857764c5bc598b9b37c9b9d653d5ab70a837f39b14e"}
Oct 31 07:34:50.963328 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:50.963280    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55" event={"ID":"bf86884b-19ca-402f-8ac1-1c822ffedcc6","Type":"ContainerStarted","Data":"07b9440fac969e699b05f1dbbb1302531d2a114e2eecfbad01451086dcaea57a"}
Oct 31 07:34:50.963814 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:50.963371    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:51.000784 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:51.000727    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55" podStartSLOduration=2.031559305 podStartE2EDuration="7.000711937s" totalImagesPullingTime="4.969152632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:34:50.999381311 +0000 UTC m=+405.528575985" watchObservedRunningTime="2026-10-31 07:34:51.000711937 +0000 UTC m=+405.529906612"
Oct 31 07:34:51.756283 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:51.756247    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:34:56.999621 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:34:56.999589    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-8fr55"
Oct 31 07:34:58.695243 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:34:58.695202    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:35:00.758677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:00.758637    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:05.778900 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:05.778864    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:09.507419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.507369    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:09.631035 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.630999    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:09.752976 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.752938    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-7vcs5"]
Oct 31 07:35:09.754184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.754159    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:09.758296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.758244    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:09.773941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.773894    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 31 07:35:09.776773 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.776670    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-7vcs5"]
Oct 31 07:35:09.787866 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.787836    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 31 07:35:09.787866 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.787855    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 31 07:35:09.788173 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.787953    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-nwp8h\""
Oct 31 07:35:09.792502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.792476    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"]
Oct 31 07:35:09.796149 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.796130    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:09.816643 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.816604    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"]
Oct 31 07:35:09.835188 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.835156    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-khttk"]
Oct 31 07:35:09.838800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.838775    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:09.849589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.849564    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-2dsp2\""
Oct 31 07:35:09.849773 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.849668    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Oct 31 07:35:09.858877 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.858849    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-khttk"]
Oct 31 07:35:09.862630 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.862602    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnhgh\" (UniqueName: \"kubernetes.io/projected/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-kube-api-access-qnhgh\") pod \"llmisvc-controller-manager-869d5dcc5d-rw52j\" (UID: \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:09.862752 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.862654    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f328eb-ec63-43e1-b042-c8802531e222-cert\") pod \"kserve-controller-manager-776cc66d47-7vcs5\" (UID: \"85f328eb-ec63-43e1-b042-c8802531e222\") " pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:09.862852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.862824    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddhtn\" (UniqueName: \"kubernetes.io/projected/85f328eb-ec63-43e1-b042-c8802531e222-kube-api-access-ddhtn\") pod \"kserve-controller-manager-776cc66d47-7vcs5\" (UID: \"85f328eb-ec63-43e1-b042-c8802531e222\") " pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:09.862889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.862868    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-rw52j\" (UID: \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:09.873997 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.873962    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-cp4r2"]
Oct 31 07:35:09.874156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.873997    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 31 07:35:09.874156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.874112    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-mjw26\""
Oct 31 07:35:09.878032 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.878015    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:09.890585 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.890552    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:09.896449 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.896424    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-cp4r2"]
Oct 31 07:35:09.963698 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.963658    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-cert\") pod \"odh-model-controller-769875db56-cp4r2\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") " pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:09.963928 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.963722    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnhgh\" (UniqueName: \"kubernetes.io/projected/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-kube-api-access-qnhgh\") pod \"llmisvc-controller-manager-869d5dcc5d-rw52j\" (UID: \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:09.963928 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.963842    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f328eb-ec63-43e1-b042-c8802531e222-cert\") pod \"kserve-controller-manager-776cc66d47-7vcs5\" (UID: \"85f328eb-ec63-43e1-b042-c8802531e222\") " pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:09.963928 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.963875    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab4eb59-90ae-4d88-98c8-06cb22a6cc66-tls-certs\") pod \"model-serving-api-75bd89fdfc-khttk\" (UID: \"7ab4eb59-90ae-4d88-98c8-06cb22a6cc66\") " pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:09.964094 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.963930    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vjwp\" (UniqueName: \"kubernetes.io/projected/a357159f-963c-45e8-bde4-7b2aab5a158e-kube-api-access-7vjwp\") pod \"odh-model-controller-769875db56-cp4r2\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") " pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:09.964094 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.964008    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-metrics-certs\") pod \"odh-model-controller-769875db56-cp4r2\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") " pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:09.964094 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.964064    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtntk\" (UniqueName: \"kubernetes.io/projected/7ab4eb59-90ae-4d88-98c8-06cb22a6cc66-kube-api-access-rtntk\") pod \"model-serving-api-75bd89fdfc-khttk\" (UID: \"7ab4eb59-90ae-4d88-98c8-06cb22a6cc66\") " pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:09.964234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.964131    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddhtn\" (UniqueName: \"kubernetes.io/projected/85f328eb-ec63-43e1-b042-c8802531e222-kube-api-access-ddhtn\") pod \"kserve-controller-manager-776cc66d47-7vcs5\" (UID: \"85f328eb-ec63-43e1-b042-c8802531e222\") " pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:09.964234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.964155    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-rw52j\" (UID: \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:09.967335 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.967285    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-rw52j\" (UID: \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:09.967596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.967574    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85f328eb-ec63-43e1-b042-c8802531e222-cert\") pod \"kserve-controller-manager-776cc66d47-7vcs5\" (UID: \"85f328eb-ec63-43e1-b042-c8802531e222\") " pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:09.974805 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.974771    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5z29g\""
Oct 31 07:35:09.974964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.974823    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 31 07:35:09.974964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.974873    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 31 07:35:09.982945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.982894    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnhgh\" (UniqueName: \"kubernetes.io/projected/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-kube-api-access-qnhgh\") pod \"llmisvc-controller-manager-869d5dcc5d-rw52j\" (UID: \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:09.983434 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:09.983416    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddhtn\" (UniqueName: \"kubernetes.io/projected/85f328eb-ec63-43e1-b042-c8802531e222-kube-api-access-ddhtn\") pod \"kserve-controller-manager-776cc66d47-7vcs5\" (UID: \"85f328eb-ec63-43e1-b042-c8802531e222\") " pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:10.008491 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.008423    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:10.064989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.064958    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtntk\" (UniqueName: \"kubernetes.io/projected/7ab4eb59-90ae-4d88-98c8-06cb22a6cc66-kube-api-access-rtntk\") pod \"model-serving-api-75bd89fdfc-khttk\" (UID: \"7ab4eb59-90ae-4d88-98c8-06cb22a6cc66\") " pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:10.065131 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.065100    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-cert\") pod \"odh-model-controller-769875db56-cp4r2\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") " pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:10.065179 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.065143    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab4eb59-90ae-4d88-98c8-06cb22a6cc66-tls-certs\") pod \"model-serving-api-75bd89fdfc-khttk\" (UID: \"7ab4eb59-90ae-4d88-98c8-06cb22a6cc66\") " pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:10.065179 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.065173    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vjwp\" (UniqueName: \"kubernetes.io/projected/a357159f-963c-45e8-bde4-7b2aab5a158e-kube-api-access-7vjwp\") pod \"odh-model-controller-769875db56-cp4r2\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") " pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:10.065252 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.065193    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-metrics-certs\") pod \"odh-model-controller-769875db56-cp4r2\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") " pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:10.067752 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.067719    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-cert\") pod \"odh-model-controller-769875db56-cp4r2\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") " pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:10.067861 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.067772    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7ab4eb59-90ae-4d88-98c8-06cb22a6cc66-tls-certs\") pod \"model-serving-api-75bd89fdfc-khttk\" (UID: \"7ab4eb59-90ae-4d88-98c8-06cb22a6cc66\") " pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:10.067861 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.067772    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-metrics-certs\") pod \"odh-model-controller-769875db56-cp4r2\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") " pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:10.073642 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.073614    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:10.083454 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.083431    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtntk\" (UniqueName: \"kubernetes.io/projected/7ab4eb59-90ae-4d88-98c8-06cb22a6cc66-kube-api-access-rtntk\") pod \"model-serving-api-75bd89fdfc-khttk\" (UID: \"7ab4eb59-90ae-4d88-98c8-06cb22a6cc66\") " pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:10.084036 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.084014    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vjwp\" (UniqueName: \"kubernetes.io/projected/a357159f-963c-45e8-bde4-7b2aab5a158e-kube-api-access-7vjwp\") pod \"odh-model-controller-769875db56-cp4r2\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") " pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:10.109859 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.109826    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:10.157363 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.157325    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:10.191326 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.191288    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:10.219507 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.219469    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:10.372348 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.372310    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-7vcs5"]
Oct 31 07:35:10.375984 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:35:10.375949    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f328eb_ec63_43e1_b042_c8802531e222.slice/crio-33906a6947a1c51bb93bd1af32e2c05ab5c7ecdc39b8a7abadc71e70217097dd WatchSource:0}: Error finding container 33906a6947a1c51bb93bd1af32e2c05ab5c7ecdc39b8a7abadc71e70217097dd: Status 404 returned error can't find the container with id 33906a6947a1c51bb93bd1af32e2c05ab5c7ecdc39b8a7abadc71e70217097dd
Oct 31 07:35:10.417040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.417002    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"]
Oct 31 07:35:10.420530 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:35:10.420499    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc6b4769e_14be_41e8_ab5d_0b22bdf1c4f2.slice/crio-f32c14d8e7be758461edd219337c5a819bc44c5c812ea81d7e5a106e90f8934b WatchSource:0}: Error finding container f32c14d8e7be758461edd219337c5a819bc44c5c812ea81d7e5a106e90f8934b: Status 404 returned error can't find the container with id f32c14d8e7be758461edd219337c5a819bc44c5c812ea81d7e5a106e90f8934b
Oct 31 07:35:10.470401 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.470356    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-khttk"]
Oct 31 07:35:10.474199 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:35:10.474166    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab4eb59_90ae_4d88_98c8_06cb22a6cc66.slice/crio-affd80f416007b683016befe611e81d99536064e4598ac558272959c57d49c10 WatchSource:0}: Error finding container affd80f416007b683016befe611e81d99536064e4598ac558272959c57d49c10: Status 404 returned error can't find the container with id affd80f416007b683016befe611e81d99536064e4598ac558272959c57d49c10
Oct 31 07:35:10.501532 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:10.501500    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-cp4r2"]
Oct 31 07:35:10.505015 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:35:10.504989    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda357159f_963c_45e8_bde4_7b2aab5a158e.slice/crio-f1d2bdcdec0a3ac23857d9f72d7f6dd36f7b20ee8ee499be41fca09ec2522ad8 WatchSource:0}: Error finding container f1d2bdcdec0a3ac23857d9f72d7f6dd36f7b20ee8ee499be41fca09ec2522ad8: Status 404 returned error can't find the container with id f1d2bdcdec0a3ac23857d9f72d7f6dd36f7b20ee8ee499be41fca09ec2522ad8
Oct 31 07:35:11.101022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:11.100933    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j" event={"ID":"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2","Type":"ContainerStarted","Data":"f32c14d8e7be758461edd219337c5a819bc44c5c812ea81d7e5a106e90f8934b"}
Oct 31 07:35:11.106105 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:11.106063    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-cp4r2" event={"ID":"a357159f-963c-45e8-bde4-7b2aab5a158e","Type":"ContainerStarted","Data":"f1d2bdcdec0a3ac23857d9f72d7f6dd36f7b20ee8ee499be41fca09ec2522ad8"}
Oct 31 07:35:11.108636 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:11.108553    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-khttk" event={"ID":"7ab4eb59-90ae-4d88-98c8-06cb22a6cc66","Type":"ContainerStarted","Data":"affd80f416007b683016befe611e81d99536064e4598ac558272959c57d49c10"}
Oct 31 07:35:11.110709 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:11.110436    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5" event={"ID":"85f328eb-ec63-43e1-b042-c8802531e222","Type":"ContainerStarted","Data":"33906a6947a1c51bb93bd1af32e2c05ab5c7ecdc39b8a7abadc71e70217097dd"}
Oct 31 07:35:11.923531 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:11.923478    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:12.040885 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:12.040844    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:12.148224 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:12.148190    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:12.265580 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:12.265325    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:12.376840 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:12.376740    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:14.138259 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:14.138171    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-khttk" event={"ID":"7ab4eb59-90ae-4d88-98c8-06cb22a6cc66","Type":"ContainerStarted","Data":"2ed18e89562af4014b8f615918f7cb7a54143381992c479340f3f78ad4d2c08c"}
Oct 31 07:35:14.138823 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:14.138259    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:14.175902 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:14.175834    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-khttk" podStartSLOduration=1.935237272 podStartE2EDuration="5.175809909s" totalImagesPullingTime="3.240572637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:35:14.175086847 +0000 UTC m=+428.704281522" watchObservedRunningTime="2026-10-31 07:35:14.175809909 +0000 UTC m=+428.705004586"
Oct 31 07:35:15.146578 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:15.146466    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-cp4r2" event={"ID":"a357159f-963c-45e8-bde4-7b2aab5a158e","Type":"ContainerStarted","Data":"296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac"}
Oct 31 07:35:15.147118 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:15.146695    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:15.148121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:15.148094    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5" event={"ID":"85f328eb-ec63-43e1-b042-c8802531e222","Type":"ContainerStarted","Data":"619590cdf8538dd552f41f0f177c0f970d7f62532c92d76dafac0a432bc83bc3"}
Oct 31 07:35:15.148257 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:15.148140    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:15.149751 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:15.149727    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j" event={"ID":"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2","Type":"ContainerStarted","Data":"b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861"}
Oct 31 07:35:15.149857 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:15.149799    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:15.201076 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:15.201016    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-cp4r2" podStartSLOduration=2.01749425 podStartE2EDuration="6.200997338s" totalImagesPullingTime="4.183503088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:35:15.198266032 +0000 UTC m=+429.727460709" watchObservedRunningTime="2026-10-31 07:35:15.200997338 +0000 UTC m=+429.730192014"
Oct 31 07:35:15.260852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:15.260797    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5" podStartSLOduration=2.030146674 podStartE2EDuration="6.260784045s" totalImagesPullingTime="4.230637371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:35:15.260025552 +0000 UTC m=+429.789220222" watchObservedRunningTime="2026-10-31 07:35:15.260784045 +0000 UTC m=+429.789978719"
Oct 31 07:35:15.327121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:15.327062    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j" podStartSLOduration=1.968446471 podStartE2EDuration="6.327045842s" totalImagesPullingTime="4.358599371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:35:15.324096577 +0000 UTC m=+429.853291250" watchObservedRunningTime="2026-10-31 07:35:15.327045842 +0000 UTC m=+429.856240517"
Oct 31 07:35:25.154498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:25.154467    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-khttk"
Oct 31 07:35:26.158040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:26.158003    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 07:35:26.213341 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:26.213300    5039 generic.go:356] "Generic (PLEG): container finished" podID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" containerID="b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861" exitCode=1
Oct 31 07:35:26.213497 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:26.213366    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j" event={"ID":"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2","Type":"ContainerDied","Data":"b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861"}
Oct 31 07:35:26.213785 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:26.213762    5039 scope.go:122] "RemoveContainer" containerID="b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861"
Oct 31 07:35:27.221452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:27.221413    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j" event={"ID":"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2","Type":"ContainerStarted","Data":"9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63"}
Oct 31 07:35:27.221951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:27.221628    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:28.697076 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:35:28.697037    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:35:33.953959 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:33.953904    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:33.994032 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:33.993992    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-jkrhs"]
Oct 31 07:35:33.997876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:33.997856    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.003298 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.003261    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-metrics-certs\") pod \"maas-controller-579cf7c6d-jkrhs\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") " pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.003459 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.003324    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-webhook-cert\") pod \"maas-controller-579cf7c6d-jkrhs\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") " pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.003534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.003467    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb7kl\" (UniqueName: \"kubernetes.io/projected/824d6694-d0eb-4d2a-b1a6-a16f958395d5-kube-api-access-zb7kl\") pod \"maas-controller-579cf7c6d-jkrhs\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") " pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.012314 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.012290    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 07:35:34.023898 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.023867    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 07:35:34.024062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.024005    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 07:35:34.024062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.024019    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rrl9j\""
Oct 31 07:35:34.027130 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.027101    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-jkrhs"]
Oct 31 07:35:34.104312 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.104279    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb7kl\" (UniqueName: \"kubernetes.io/projected/824d6694-d0eb-4d2a-b1a6-a16f958395d5-kube-api-access-zb7kl\") pod \"maas-controller-579cf7c6d-jkrhs\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") " pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.104493 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.104323    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-metrics-certs\") pod \"maas-controller-579cf7c6d-jkrhs\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") " pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.104493 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.104352    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-webhook-cert\") pod \"maas-controller-579cf7c6d-jkrhs\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") " pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.106977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.106942    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-webhook-cert\") pod \"maas-controller-579cf7c6d-jkrhs\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") " pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.107107 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.106942    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-metrics-certs\") pod \"maas-controller-579cf7c6d-jkrhs\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") " pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.128891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.128855    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb7kl\" (UniqueName: \"kubernetes.io/projected/824d6694-d0eb-4d2a-b1a6-a16f958395d5-kube-api-access-zb7kl\") pod \"maas-controller-579cf7c6d-jkrhs\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") " pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.147424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.147382    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:34.264846 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.264756    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:34.311938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.311874    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:34.609572 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:34.609487    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-jkrhs"]
Oct 31 07:35:34.613596 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:35:34.613570    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824d6694_d0eb_4d2a_b1a6_a16f958395d5.slice/crio-29d20a7c099df3d7940ae7949900745b02d052e0c8f4dcea5849f224ec103657 WatchSource:0}: Error finding container 29d20a7c099df3d7940ae7949900745b02d052e0c8f4dcea5849f224ec103657: Status 404 returned error can't find the container with id 29d20a7c099df3d7940ae7949900745b02d052e0c8f4dcea5849f224ec103657
Oct 31 07:35:35.271463 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:35.271416    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-jkrhs" event={"ID":"824d6694-d0eb-4d2a-b1a6-a16f958395d5","Type":"ContainerStarted","Data":"29d20a7c099df3d7940ae7949900745b02d052e0c8f4dcea5849f224ec103657"}
Oct 31 07:35:37.285043 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:37.285002    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-jkrhs" event={"ID":"824d6694-d0eb-4d2a-b1a6-a16f958395d5","Type":"ContainerStarted","Data":"536ed85828ee1fe97846e6550fb54651ce20246d2ef41d2e91f5a2fc8ffefdb7"}
Oct 31 07:35:37.285519 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:37.285106    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:37.316026 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:37.315988    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:37.324728 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:37.324631    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-jkrhs" podStartSLOduration=1.865103819 podStartE2EDuration="4.324617176s" totalImagesPullingTime="2.459513357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:35:37.323790458 +0000 UTC m=+451.852985113" watchObservedRunningTime="2026-10-31 07:35:37.324617176 +0000 UTC m=+451.853811850"
Oct 31 07:35:37.440906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:37.440871    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:39.183928 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:39.183876    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:39.383056 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:39.383013    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:35:46.161051 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:46.161019    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-7vcs5"
Oct 31 07:35:48.294097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:48.294060    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:49.173367 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.173326    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-jkrhs"]
Oct 31 07:35:49.173583 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.173559    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-jkrhs" podUID="824d6694-d0eb-4d2a-b1a6-a16f958395d5" containerName="manager" containerID="cri-o://536ed85828ee1fe97846e6550fb54651ce20246d2ef41d2e91f5a2fc8ffefdb7" gracePeriod=30
Oct 31 07:35:49.357102 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.357070    5039 generic.go:356] "Generic (PLEG): container finished" podID="824d6694-d0eb-4d2a-b1a6-a16f958395d5" containerID="536ed85828ee1fe97846e6550fb54651ce20246d2ef41d2e91f5a2fc8ffefdb7" exitCode=0
Oct 31 07:35:49.357559 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.357108    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-jkrhs" event={"ID":"824d6694-d0eb-4d2a-b1a6-a16f958395d5","Type":"ContainerDied","Data":"536ed85828ee1fe97846e6550fb54651ce20246d2ef41d2e91f5a2fc8ffefdb7"}
Oct 31 07:35:49.415933 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.415895    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:49.450826 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.450739    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-webhook-cert\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-webhook-cert\") pod \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") "
Oct 31 07:35:49.450826 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.450780    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/824d6694-d0eb-4d2a-b1a6-a16f958395d5-kube-api-access-zb7kl\" (UniqueName: \"kubernetes.io/projected/824d6694-d0eb-4d2a-b1a6-a16f958395d5-kube-api-access-zb7kl\") pod \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") "
Oct 31 07:35:49.451066 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.450838    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-metrics-certs\") pod \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\" (UID: \"824d6694-d0eb-4d2a-b1a6-a16f958395d5\") "
Oct 31 07:35:49.453231 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.453175    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-webhook-cert" pod "824d6694-d0eb-4d2a-b1a6-a16f958395d5" (UID: "824d6694-d0eb-4d2a-b1a6-a16f958395d5"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:35:49.453361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.453258    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-metrics-certs" pod "824d6694-d0eb-4d2a-b1a6-a16f958395d5" (UID: "824d6694-d0eb-4d2a-b1a6-a16f958395d5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:35:49.453361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.453266    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824d6694-d0eb-4d2a-b1a6-a16f958395d5-kube-api-access-zb7kl" pod "824d6694-d0eb-4d2a-b1a6-a16f958395d5" (UID: "824d6694-d0eb-4d2a-b1a6-a16f958395d5"). InnerVolumeSpecName "kube-api-access-zb7kl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:35:49.551613 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.551574    5039 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-webhook-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:35:49.551613 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.551608    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zb7kl\" (UniqueName: \"kubernetes.io/projected/824d6694-d0eb-4d2a-b1a6-a16f958395d5-kube-api-access-zb7kl\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:35:49.551613 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:49.551619    5039 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/824d6694-d0eb-4d2a-b1a6-a16f958395d5-metrics-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:35:50.364212 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:50.364177    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-jkrhs"
Oct 31 07:35:50.364658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:50.364209    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-jkrhs" event={"ID":"824d6694-d0eb-4d2a-b1a6-a16f958395d5","Type":"ContainerDied","Data":"29d20a7c099df3d7940ae7949900745b02d052e0c8f4dcea5849f224ec103657"}
Oct 31 07:35:50.364658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:50.364279    5039 scope.go:122] "RemoveContainer" containerID="536ed85828ee1fe97846e6550fb54651ce20246d2ef41d2e91f5a2fc8ffefdb7"
Oct 31 07:35:50.411044 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:50.410998    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-jkrhs"]
Oct 31 07:35:50.422376 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:50.422341    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-jkrhs"]
Oct 31 07:35:51.614264 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:51.614222    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="824d6694-d0eb-4d2a-b1a6-a16f958395d5" path="/var/lib/kubelet/pods/824d6694-d0eb-4d2a-b1a6-a16f958395d5/volumes"
Oct 31 07:35:58.229133 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:35:58.229095    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:35:58.695794 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:35:58.695695    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:36:00.800248 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:00.800203    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:05.517786 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:05.517752    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:05.616490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:05.616456    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:05.881075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:05.880982    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:07.746896 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:07.746862    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:07.886180 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:07.886148    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:09.207475 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:09.207441    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:09.437365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:09.437329    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:10.647028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.646993    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:10.762396 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.762360    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:10.876565 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.876526    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:10.886452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.886416    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"]
Oct 31 07:36:10.887057 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.887034    5039 cpu_manager.go:414] "containerMap: removing container" podUID="824d6694-d0eb-4d2a-b1a6-a16f958395d5" containerName="manager"
Oct 31 07:36:10.887057 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.887056    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="824d6694-d0eb-4d2a-b1a6-a16f958395d5" containerName="manager"
Oct 31 07:36:10.887296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.887278    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="824d6694-d0eb-4d2a-b1a6-a16f958395d5" containerName="manager"
Oct 31 07:36:10.893493 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.893470    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:10.923540 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.923509    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4n7bj\""
Oct 31 07:36:10.923724 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.923700    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 07:36:10.923789 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.923616    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 31 07:36:10.927297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:10.927270    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"]
Oct 31 07:36:11.048388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.048348    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4160592-698b-4b73-a462-b69ff36a5927-openshift-service-ca\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.048388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.048388    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-metrics-certs\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.048608 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.048526    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-maas-api-tls\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.048608 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.048567    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x6g2\" (UniqueName: \"kubernetes.io/projected/f4160592-698b-4b73-a462-b69ff36a5927-kube-api-access-8x6g2\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.149432 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.149390    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x6g2\" (UniqueName: \"kubernetes.io/projected/f4160592-698b-4b73-a462-b69ff36a5927-kube-api-access-8x6g2\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.149617 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.149477    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4160592-698b-4b73-a462-b69ff36a5927-openshift-service-ca\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.149617 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.149499    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-metrics-certs\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.149617 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.149562    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-maas-api-tls\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.150184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.150160    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4160592-698b-4b73-a462-b69ff36a5927-openshift-service-ca\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.152183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.152129    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-metrics-certs\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.152183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.152173    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-maas-api-tls\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.167627 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.167599    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x6g2\" (UniqueName: \"kubernetes.io/projected/f4160592-698b-4b73-a462-b69ff36a5927-kube-api-access-8x6g2\") pod \"maas-api-6d669c7fcd-qbhd8\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.206415 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.206376    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:11.506416 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:11.506378    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"]
Oct 31 07:36:11.510895 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:36:11.510859    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4160592_698b_4b73_a462_b69ff36a5927.slice/crio-fd20835e9e277100005e4525781bf2a2ad465e71d52b704625000c33c5123b14 WatchSource:0}: Error finding container fd20835e9e277100005e4525781bf2a2ad465e71d52b704625000c33c5123b14: Status 404 returned error can't find the container with id fd20835e9e277100005e4525781bf2a2ad465e71d52b704625000c33c5123b14
Oct 31 07:36:12.483633 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:12.483590    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8" event={"ID":"f4160592-698b-4b73-a462-b69ff36a5927","Type":"ContainerStarted","Data":"fd20835e9e277100005e4525781bf2a2ad465e71d52b704625000c33c5123b14"}
Oct 31 07:36:13.490741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:13.490703    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8" event={"ID":"f4160592-698b-4b73-a462-b69ff36a5927","Type":"ContainerStarted","Data":"0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e"}
Oct 31 07:36:13.491245 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:13.490877    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:13.527962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:13.527883    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8" podStartSLOduration=1.737415503 podStartE2EDuration="3.527867398s" totalImagesPullingTime="1.790451895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:36:13.527431213 +0000 UTC m=+488.056625889" watchObservedRunningTime="2026-10-31 07:36:13.527867398 +0000 UTC m=+488.057062072"
Oct 31 07:36:19.502340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:19.502301    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:20.749571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:20.747209    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:20.856069 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:20.856037    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:36:21.040629 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.040537    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-jd4fj"]
Oct 31 07:36:21.044442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.044415    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj"
Oct 31 07:36:21.048768 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.048732    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4js66\" (UniqueName: \"kubernetes.io/projected/c84fcd62-a6c8-4e37-b8c7-b33e237b88fc-kube-api-access-4js66\") pod \"authorino-6f6944bcdd-jd4fj\" (UID: \"c84fcd62-a6c8-4e37-b8c7-b33e237b88fc\") " pod="kuadrant-system/authorino-6f6944bcdd-jd4fj"
Oct 31 07:36:21.063404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.063371    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-jd4fj"]
Oct 31 07:36:21.149569 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.149518    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4js66\" (UniqueName: \"kubernetes.io/projected/c84fcd62-a6c8-4e37-b8c7-b33e237b88fc-kube-api-access-4js66\") pod \"authorino-6f6944bcdd-jd4fj\" (UID: \"c84fcd62-a6c8-4e37-b8c7-b33e237b88fc\") " pod="kuadrant-system/authorino-6f6944bcdd-jd4fj"
Oct 31 07:36:21.168095 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.168064    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4js66\" (UniqueName: \"kubernetes.io/projected/c84fcd62-a6c8-4e37-b8c7-b33e237b88fc-kube-api-access-4js66\") pod \"authorino-6f6944bcdd-jd4fj\" (UID: \"c84fcd62-a6c8-4e37-b8c7-b33e237b88fc\") " pod="kuadrant-system/authorino-6f6944bcdd-jd4fj"
Oct 31 07:36:21.240273 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.240232    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-jd4fj"]
Oct 31 07:36:21.240533 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.240515    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj"
Oct 31 07:36:21.267299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.267263    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-76gkh"]
Oct 31 07:36:21.272178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.272141    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:21.289401 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.289374    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-76gkh"]
Oct 31 07:36:21.289653 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.289641    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Oct 31 07:36:21.350660 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.350628    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gcb6\" (UniqueName: \"kubernetes.io/projected/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-kube-api-access-9gcb6\") pod \"authorino-6889cbd8c4-76gkh\" (UID: \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\") " pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:21.350660 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.350670    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-tls-cert\") pod \"authorino-6889cbd8c4-76gkh\" (UID: \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\") " pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:21.409543 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.409471    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-76gkh"]
Oct 31 07:36:21.409759 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:36:21.409734    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9gcb6 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6889cbd8c4-76gkh" podUID="10d54ce9-a4d3-4d7e-9c84-93cde53e6d67"
Oct 31 07:36:21.434401 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.434370    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-594f9d5b5f-ntsb4"]
Oct 31 07:36:21.438221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.438197    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:36:21.452060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.452033    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gcb6\" (UniqueName: \"kubernetes.io/projected/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-kube-api-access-9gcb6\") pod \"authorino-6889cbd8c4-76gkh\" (UID: \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\") " pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:21.452197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.452071    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-tls-cert\") pod \"authorino-6889cbd8c4-76gkh\" (UID: \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\") " pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:21.452197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.452107    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxcmm\" (UniqueName: \"kubernetes.io/projected/5d623fce-e9e8-4ecf-893d-104507d22f6a-kube-api-access-mxcmm\") pod \"authorino-594f9d5b5f-ntsb4\" (UID: \"5d623fce-e9e8-4ecf-893d-104507d22f6a\") " pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:36:21.452197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.452139    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5d623fce-e9e8-4ecf-893d-104507d22f6a-tls-cert\") pod \"authorino-594f9d5b5f-ntsb4\" (UID: \"5d623fce-e9e8-4ecf-893d-104507d22f6a\") " pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:36:21.454490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.454463    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-tls-cert\") pod \"authorino-6889cbd8c4-76gkh\" (UID: \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\") " pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:21.457971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.457942    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594f9d5b5f-ntsb4"]
Oct 31 07:36:21.469958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.469908    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gcb6\" (UniqueName: \"kubernetes.io/projected/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-kube-api-access-9gcb6\") pod \"authorino-6889cbd8c4-76gkh\" (UID: \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\") " pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:21.536522 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.536490    5039 generic.go:356] "Generic (PLEG): container finished" podID="7942b45d-8533-4089-a961-751c59ba0591" containerID="11c73a1f3805424265493b2634d572e7bf6c97754bb10341f50000c8dbfc5da5" exitCode=0
Oct 31 07:36:21.536690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.536565    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" event={"ID":"7942b45d-8533-4089-a961-751c59ba0591","Type":"ContainerDied","Data":"11c73a1f3805424265493b2634d572e7bf6c97754bb10341f50000c8dbfc5da5"}
Oct 31 07:36:21.536690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.536647    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:21.536977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.536964    5039 scope.go:122] "RemoveContainer" containerID="11c73a1f3805424265493b2634d572e7bf6c97754bb10341f50000c8dbfc5da5"
Oct 31 07:36:21.538187 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.538157    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:36:21.538290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.538225    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:36:21.538290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.538260    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:36:21.543664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.543642    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-jd4fj"]
Oct 31 07:36:21.546205 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.546183    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:21.547907 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:36:21.547874    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc84fcd62_a6c8_4e37_b8c7_b33e237b88fc.slice/crio-0ec3500ea4c6d57774e49fe5d1084dea08951ad0ceaae9ff0c89e4879091f703 WatchSource:0}: Error finding container 0ec3500ea4c6d57774e49fe5d1084dea08951ad0ceaae9ff0c89e4879091f703: Status 404 returned error can't find the container with id 0ec3500ea4c6d57774e49fe5d1084dea08951ad0ceaae9ff0c89e4879091f703
Oct 31 07:36:21.552570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.552524    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-kube-api-access-9gcb6\" (UniqueName: \"kubernetes.io/projected/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-kube-api-access-9gcb6\") pod \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\" (UID: \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\") "
Oct 31 07:36:21.552649 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.552593    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-tls-cert\" (UniqueName: \"kubernetes.io/secret/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-tls-cert\") pod \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\" (UID: \"10d54ce9-a4d3-4d7e-9c84-93cde53e6d67\") "
Oct 31 07:36:21.552710 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.552676    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxcmm\" (UniqueName: \"kubernetes.io/projected/5d623fce-e9e8-4ecf-893d-104507d22f6a-kube-api-access-mxcmm\") pod \"authorino-594f9d5b5f-ntsb4\" (UID: \"5d623fce-e9e8-4ecf-893d-104507d22f6a\") " pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:36:21.552765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.552718    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5d623fce-e9e8-4ecf-893d-104507d22f6a-tls-cert\") pod \"authorino-594f9d5b5f-ntsb4\" (UID: \"5d623fce-e9e8-4ecf-893d-104507d22f6a\") " pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:36:21.554663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.554639    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-tls-cert" pod "10d54ce9-a4d3-4d7e-9c84-93cde53e6d67" (UID: "10d54ce9-a4d3-4d7e-9c84-93cde53e6d67"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:36:21.554752 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.554715    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-kube-api-access-9gcb6" pod "10d54ce9-a4d3-4d7e-9c84-93cde53e6d67" (UID: "10d54ce9-a4d3-4d7e-9c84-93cde53e6d67"). InnerVolumeSpecName "kube-api-access-9gcb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:36:21.555450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.555430    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5d623fce-e9e8-4ecf-893d-104507d22f6a-tls-cert\") pod \"authorino-594f9d5b5f-ntsb4\" (UID: \"5d623fce-e9e8-4ecf-893d-104507d22f6a\") " pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:36:21.570781 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.570756    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxcmm\" (UniqueName: \"kubernetes.io/projected/5d623fce-e9e8-4ecf-893d-104507d22f6a-kube-api-access-mxcmm\") pod \"authorino-594f9d5b5f-ntsb4\" (UID: \"5d623fce-e9e8-4ecf-893d-104507d22f6a\") " pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:36:21.654563 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.654523    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gcb6\" (UniqueName: \"kubernetes.io/projected/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-kube-api-access-9gcb6\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:21.654563 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.654559    5039 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67-tls-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:21.750122 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.750074    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:36:21.994747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:21.994713    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:36:22.078430 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.078387    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-594f9d5b5f-ntsb4"]
Oct 31 07:36:22.081774 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:36:22.081741    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d623fce_e9e8_4ecf_893d_104507d22f6a.slice/crio-84a71ab3d2dfda54dbab339d2f91c3ce825520c9d85867724e3592f6c90525b0 WatchSource:0}: Error finding container 84a71ab3d2dfda54dbab339d2f91c3ce825520c9d85867724e3592f6c90525b0: Status 404 returned error can't find the container with id 84a71ab3d2dfda54dbab339d2f91c3ce825520c9d85867724e3592f6c90525b0
Oct 31 07:36:22.546304 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.546000    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" event={"ID":"7942b45d-8533-4089-a961-751c59ba0591","Type":"ContainerStarted","Data":"e3b9e92bfeb538a546470dcdc91dc54647e8aaaf1d82f30e34d3de41c0653b13"}
Oct 31 07:36:22.548307 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.548271    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj" podUID="c84fcd62-a6c8-4e37-b8c7-b33e237b88fc" containerName="authorino" containerID="cri-o://884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1" gracePeriod=30
Oct 31 07:36:22.548436 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.548278    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj" event={"ID":"c84fcd62-a6c8-4e37-b8c7-b33e237b88fc","Type":"ContainerStarted","Data":"884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1"}
Oct 31 07:36:22.548515 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.548432    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj" event={"ID":"c84fcd62-a6c8-4e37-b8c7-b33e237b88fc","Type":"ContainerStarted","Data":"0ec3500ea4c6d57774e49fe5d1084dea08951ad0ceaae9ff0c89e4879091f703"}
Oct 31 07:36:22.550013 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.549987    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6889cbd8c4-76gkh"
Oct 31 07:36:22.550501 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.550478    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4" event={"ID":"5d623fce-e9e8-4ecf-893d-104507d22f6a","Type":"ContainerStarted","Data":"84a71ab3d2dfda54dbab339d2f91c3ce825520c9d85867724e3592f6c90525b0"}
Oct 31 07:36:22.645738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.645685    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-76gkh"]
Oct 31 07:36:22.648197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.648161    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6889cbd8c4-76gkh"]
Oct 31 07:36:22.688798 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.688739    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj" podStartSLOduration=1.156526597 podStartE2EDuration="1.688724511s" totalImagesPullingTime="532.197914ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:36:22.686311599 +0000 UTC m=+497.215506273" watchObservedRunningTime="2026-10-31 07:36:22.688724511 +0000 UTC m=+497.217919185"
Oct 31 07:36:22.891508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.891261    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj"
Oct 31 07:36:22.987341 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.987302    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c84fcd62-a6c8-4e37-b8c7-b33e237b88fc-kube-api-access-4js66\" (UniqueName: \"kubernetes.io/projected/c84fcd62-a6c8-4e37-b8c7-b33e237b88fc-kube-api-access-4js66\") pod \"c84fcd62-a6c8-4e37-b8c7-b33e237b88fc\" (UID: \"c84fcd62-a6c8-4e37-b8c7-b33e237b88fc\") "
Oct 31 07:36:22.991333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:22.991295    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c84fcd62-a6c8-4e37-b8c7-b33e237b88fc-kube-api-access-4js66" pod "c84fcd62-a6c8-4e37-b8c7-b33e237b88fc" (UID: "c84fcd62-a6c8-4e37-b8c7-b33e237b88fc"). InnerVolumeSpecName "kube-api-access-4js66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:36:23.088597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.088500    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4js66\" (UniqueName: \"kubernetes.io/projected/c84fcd62-a6c8-4e37-b8c7-b33e237b88fc-kube-api-access-4js66\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:23.492297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.492193    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:36:23.494364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.494002    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rxdnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 07:36:23.494364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.494069    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 07:36:23.580473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.580435    5039 generic.go:356] "Generic (PLEG): container finished" podID="c84fcd62-a6c8-4e37-b8c7-b33e237b88fc" containerID="884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1" exitCode=0
Oct 31 07:36:23.580762 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.580483    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj"
Oct 31 07:36:23.580947 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.580483    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj" event={"ID":"c84fcd62-a6c8-4e37-b8c7-b33e237b88fc","Type":"ContainerDied","Data":"884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1"}
Oct 31 07:36:23.581027 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.580954    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-jd4fj" event={"ID":"c84fcd62-a6c8-4e37-b8c7-b33e237b88fc","Type":"ContainerDied","Data":"0ec3500ea4c6d57774e49fe5d1084dea08951ad0ceaae9ff0c89e4879091f703"}
Oct 31 07:36:23.581027 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.580987    5039 scope.go:122] "RemoveContainer" containerID="884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1"
Oct 31 07:36:23.583353 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.583319    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4" event={"ID":"5d623fce-e9e8-4ecf-893d-104507d22f6a","Type":"ContainerStarted","Data":"cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd"}
Oct 31 07:36:23.593690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.593053    5039 scope.go:122] "RemoveContainer" containerID="884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1"
Oct 31 07:36:23.594187 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:36:23.594155    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1\": container with ID starting with 884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1 not found: ID does not exist" containerID="884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1"
Oct 31 07:36:23.594316 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.594212    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1"} err="failed to get container status \"884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1\": rpc error: code = NotFound desc = could not find container \"884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1\": container with ID starting with 884baae6040b3d7fd14b8fb3084dbf28d99eaae6e9b51bf953699804bf37d5a1 not found: ID does not exist"
Oct 31 07:36:23.619227 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.619193    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10d54ce9-a4d3-4d7e-9c84-93cde53e6d67" path="/var/lib/kubelet/pods/10d54ce9-a4d3-4d7e-9c84-93cde53e6d67/volumes"
Oct 31 07:36:23.627311 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.627279    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-jd4fj"]
Oct 31 07:36:23.631008 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.630979    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-jd4fj"]
Oct 31 07:36:23.678715 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.678659    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4" podStartSLOduration=2.207284574 podStartE2EDuration="2.678642756s" totalImagesPullingTime="471.358182ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:36:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:36:23.676328436 +0000 UTC m=+498.205523111" watchObservedRunningTime="2026-10-31 07:36:23.678642756 +0000 UTC m=+498.207837482"
Oct 31 07:36:23.696810 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.696776    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-bl7n2"]
Oct 31 07:36:23.697175 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:23.697137    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2" podUID="b0c75265-257d-42bc-9f99-018a256bf044" containerName="authorino" containerID="cri-o://abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3" gracePeriod=30
Oct 31 07:36:24.000874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.000844    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2"
Oct 31 07:36:24.098310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.098228    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b0c75265-257d-42bc-9f99-018a256bf044-kube-api-access-b77xp\" (UniqueName: \"kubernetes.io/projected/b0c75265-257d-42bc-9f99-018a256bf044-kube-api-access-b77xp\") pod \"b0c75265-257d-42bc-9f99-018a256bf044\" (UID: \"b0c75265-257d-42bc-9f99-018a256bf044\") "
Oct 31 07:36:24.100367 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.100339    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0c75265-257d-42bc-9f99-018a256bf044-kube-api-access-b77xp" pod "b0c75265-257d-42bc-9f99-018a256bf044" (UID: "b0c75265-257d-42bc-9f99-018a256bf044"). InnerVolumeSpecName "kube-api-access-b77xp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:36:24.199321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.199273    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b77xp\" (UniqueName: \"kubernetes.io/projected/b0c75265-257d-42bc-9f99-018a256bf044-kube-api-access-b77xp\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:24.491528 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.491483    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rxdnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 07:36:24.491711 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.491546    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 07:36:24.539231 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.539010    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"]
Oct 31 07:36:24.539625 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.539604    5039 cpu_manager.go:414] "containerMap: removing container" podUID="b0c75265-257d-42bc-9f99-018a256bf044" containerName="authorino"
Oct 31 07:36:24.539692 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.539626    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b0c75265-257d-42bc-9f99-018a256bf044" containerName="authorino"
Oct 31 07:36:24.539692 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.539651    5039 cpu_manager.go:414] "containerMap: removing container" podUID="c84fcd62-a6c8-4e37-b8c7-b33e237b88fc" containerName="authorino"
Oct 31 07:36:24.539692 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.539657    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c84fcd62-a6c8-4e37-b8c7-b33e237b88fc" containerName="authorino"
Oct 31 07:36:24.539790 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.539724    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="b0c75265-257d-42bc-9f99-018a256bf044" containerName="authorino"
Oct 31 07:36:24.539790 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.539734    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="c84fcd62-a6c8-4e37-b8c7-b33e237b88fc" containerName="authorino"
Oct 31 07:36:24.543018 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.542995    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:24.579318 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.578491    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"]
Oct 31 07:36:24.592737 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.592703    5039 generic.go:356] "Generic (PLEG): container finished" podID="b0c75265-257d-42bc-9f99-018a256bf044" containerID="abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3" exitCode=0
Oct 31 07:36:24.592962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.592743    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2"
Oct 31 07:36:24.592962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.592763    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2" event={"ID":"b0c75265-257d-42bc-9f99-018a256bf044","Type":"ContainerDied","Data":"abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3"}
Oct 31 07:36:24.592962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.592819    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c6c9ddd5-bl7n2" event={"ID":"b0c75265-257d-42bc-9f99-018a256bf044","Type":"ContainerDied","Data":"326a0fa9446efd5420ce8b5996c721e429cffa39f49b246542be83f003e97353"}
Oct 31 07:36:24.592962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.592841    5039 scope.go:122] "RemoveContainer" containerID="abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3"
Oct 31 07:36:24.602393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.602348    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7fa6638-6657-4a9c-8ffe-d0b933d2382b-cert\") pod \"llmisvc-controller-manager-6466c554d8-82fjs\" (UID: \"d7fa6638-6657-4a9c-8ffe-d0b933d2382b\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:24.603060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.603014    5039 scope.go:122] "RemoveContainer" containerID="abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3"
Oct 31 07:36:24.603212 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.603106    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4js8w\" (UniqueName: \"kubernetes.io/projected/d7fa6638-6657-4a9c-8ffe-d0b933d2382b-kube-api-access-4js8w\") pod \"llmisvc-controller-manager-6466c554d8-82fjs\" (UID: \"d7fa6638-6657-4a9c-8ffe-d0b933d2382b\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:24.603570 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:36:24.603550    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3\": container with ID starting with abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3 not found: ID does not exist" containerID="abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3"
Oct 31 07:36:24.603648 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.603576    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3"} err="failed to get container status \"abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3\": rpc error: code = NotFound desc = could not find container \"abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3\": container with ID starting with abe7db8e45f10145ec54ae1cec450b2888f5eb666da45bd8df6fbb1611308ca3 not found: ID does not exist"
Oct 31 07:36:24.647166 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.647132    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-bl7n2"]
Oct 31 07:36:24.649353 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.649326    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c6c9ddd5-bl7n2"]
Oct 31 07:36:24.704515 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.704475    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4js8w\" (UniqueName: \"kubernetes.io/projected/d7fa6638-6657-4a9c-8ffe-d0b933d2382b-kube-api-access-4js8w\") pod \"llmisvc-controller-manager-6466c554d8-82fjs\" (UID: \"d7fa6638-6657-4a9c-8ffe-d0b933d2382b\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:24.704687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.704532    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7fa6638-6657-4a9c-8ffe-d0b933d2382b-cert\") pod \"llmisvc-controller-manager-6466c554d8-82fjs\" (UID: \"d7fa6638-6657-4a9c-8ffe-d0b933d2382b\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:24.707135 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.707109    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d7fa6638-6657-4a9c-8ffe-d0b933d2382b-cert\") pod \"llmisvc-controller-manager-6466c554d8-82fjs\" (UID: \"d7fa6638-6657-4a9c-8ffe-d0b933d2382b\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:24.722450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.722412    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4js8w\" (UniqueName: \"kubernetes.io/projected/d7fa6638-6657-4a9c-8ffe-d0b933d2382b-kube-api-access-4js8w\") pod \"llmisvc-controller-manager-6466c554d8-82fjs\" (UID: \"d7fa6638-6657-4a9c-8ffe-d0b933d2382b\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:24.881744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:24.881647    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:25.181000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:25.180892    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"]
Oct 31 07:36:25.185132 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:36:25.185093    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7fa6638_6657_4a9c_8ffe_d0b933d2382b.slice/crio-24b4222cd22fb3de9d91e35fac3404f5cca327111db805d7e6fb2538446be33f WatchSource:0}: Error finding container 24b4222cd22fb3de9d91e35fac3404f5cca327111db805d7e6fb2538446be33f: Status 404 returned error can't find the container with id 24b4222cd22fb3de9d91e35fac3404f5cca327111db805d7e6fb2538446be33f
Oct 31 07:36:25.491127 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:25.491089    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rxdnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 07:36:25.491309 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:25.491152    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 07:36:25.601719 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:25.601683    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs" event={"ID":"d7fa6638-6657-4a9c-8ffe-d0b933d2382b","Type":"ContainerStarted","Data":"24b4222cd22fb3de9d91e35fac3404f5cca327111db805d7e6fb2538446be33f"}
Oct 31 07:36:25.613926 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:25.613891    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b0c75265-257d-42bc-9f99-018a256bf044" path="/var/lib/kubelet/pods/b0c75265-257d-42bc-9f99-018a256bf044/volumes"
Oct 31 07:36:25.614273 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:25.614258    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c84fcd62-a6c8-4e37-b8c7-b33e237b88fc" path="/var/lib/kubelet/pods/c84fcd62-a6c8-4e37-b8c7-b33e237b88fc/volumes"
Oct 31 07:36:26.491755 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:26.491706    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rxdnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 07:36:26.492278 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:26.491774    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 07:36:26.608550 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:26.608503    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs" event={"ID":"d7fa6638-6657-4a9c-8ffe-d0b933d2382b","Type":"ContainerStarted","Data":"fb604257d7d965285bfe1a1aff03011a7c8eb77ade851f822f11c651acc466ac"}
Oct 31 07:36:26.608749 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:26.608583    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:26.644550 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:26.644496    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs" podStartSLOduration=2.252928225 podStartE2EDuration="2.644484572s" totalImagesPullingTime="391.556347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:36:26.643499551 +0000 UTC m=+501.172694226" watchObservedRunningTime="2026-10-31 07:36:26.644484572 +0000 UTC m=+501.173679245"
Oct 31 07:36:27.491615 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:27.491576    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rxdnz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Oct 31 07:36:27.491811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:27.491638    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Oct 31 07:36:28.494882 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:28.494850    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:36:28.495292 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:28.495150    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:36:28.495806 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:28.495786    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 07:36:28.696687 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:36:28.696645    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:36:30.370054 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.370014    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"]
Oct 31 07:36:30.370675 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.370236    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8" podUID="f4160592-698b-4b73-a462-b69ff36a5927" containerName="maas-api" containerID="cri-o://0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e" gracePeriod=30
Oct 31 07:36:30.621037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.620968    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:30.632569 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.632532    5039 generic.go:356] "Generic (PLEG): container finished" podID="f4160592-698b-4b73-a462-b69ff36a5927" containerID="0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e" exitCode=0
Oct 31 07:36:30.632717 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.632584    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"
Oct 31 07:36:30.632717 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.632615    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8" event={"ID":"f4160592-698b-4b73-a462-b69ff36a5927","Type":"ContainerDied","Data":"0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e"}
Oct 31 07:36:30.632717 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.632670    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8" event={"ID":"f4160592-698b-4b73-a462-b69ff36a5927","Type":"ContainerDied","Data":"fd20835e9e277100005e4525781bf2a2ad465e71d52b704625000c33c5123b14"}
Oct 31 07:36:30.632717 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.632695    5039 scope.go:122] "RemoveContainer" containerID="0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e"
Oct 31 07:36:30.641859 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.641829    5039 scope.go:122] "RemoveContainer" containerID="0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e"
Oct 31 07:36:30.642143 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:36:30.642125    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e\": container with ID starting with 0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e not found: ID does not exist" containerID="0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e"
Oct 31 07:36:30.642231 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.642151    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e"} err="failed to get container status \"0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e\": rpc error: code = NotFound desc = could not find container \"0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e\": container with ID starting with 0cf9eab71170d3b3f1fbe92d24838f4862de5b373dede655ff05687ef7755d2e not found: ID does not exist"
Oct 31 07:36:30.653600 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.653579    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f4160592-698b-4b73-a462-b69ff36a5927-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4160592-698b-4b73-a462-b69ff36a5927-openshift-service-ca\") pod \"f4160592-698b-4b73-a462-b69ff36a5927\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") "
Oct 31 07:36:30.653706 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.653664    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4160592-698b-4b73-a462-b69ff36a5927-kube-api-access-8x6g2\" (UniqueName: \"kubernetes.io/projected/f4160592-698b-4b73-a462-b69ff36a5927-kube-api-access-8x6g2\") pod \"f4160592-698b-4b73-a462-b69ff36a5927\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") "
Oct 31 07:36:30.653706 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.653693    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-maas-api-tls\") pod \"f4160592-698b-4b73-a462-b69ff36a5927\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") "
Oct 31 07:36:30.653827 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.653764    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-metrics-certs\") pod \"f4160592-698b-4b73-a462-b69ff36a5927\" (UID: \"f4160592-698b-4b73-a462-b69ff36a5927\") "
Oct 31 07:36:30.653997 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.653974    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4160592-698b-4b73-a462-b69ff36a5927-openshift-service-ca" pod "f4160592-698b-4b73-a462-b69ff36a5927" (UID: "f4160592-698b-4b73-a462-b69ff36a5927"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:36:30.655904 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.655874    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-maas-api-tls" pod "f4160592-698b-4b73-a462-b69ff36a5927" (UID: "f4160592-698b-4b73-a462-b69ff36a5927"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:36:30.656036 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.655911    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4160592-698b-4b73-a462-b69ff36a5927-kube-api-access-8x6g2" pod "f4160592-698b-4b73-a462-b69ff36a5927" (UID: "f4160592-698b-4b73-a462-b69ff36a5927"). InnerVolumeSpecName "kube-api-access-8x6g2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:36:30.656036 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.655952    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-metrics-certs" pod "f4160592-698b-4b73-a462-b69ff36a5927" (UID: "f4160592-698b-4b73-a462-b69ff36a5927"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:36:30.755206 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.755163    5039 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-metrics-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:30.755206 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.755198    5039 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4160592-698b-4b73-a462-b69ff36a5927-openshift-service-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:30.755206 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.755210    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8x6g2\" (UniqueName: \"kubernetes.io/projected/f4160592-698b-4b73-a462-b69ff36a5927-kube-api-access-8x6g2\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:30.755457 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.755219    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4160592-698b-4b73-a462-b69ff36a5927-maas-api-tls\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:30.976067 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.976031    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"]
Oct 31 07:36:30.987398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:30.987368    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-qbhd8"]
Oct 31 07:36:31.614515 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:31.614475    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4160592-698b-4b73-a462-b69ff36a5927" path="/var/lib/kubelet/pods/f4160592-698b-4b73-a462-b69ff36a5927/volumes"
Oct 31 07:36:57.617600 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:57.617566    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82fjs"
Oct 31 07:36:57.679866 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:57.679827    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"]
Oct 31 07:36:57.680128 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:57.680099    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j" podUID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" containerName="manager" containerID="cri-o://9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63" gracePeriod=30
Oct 31 07:36:57.934663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:57.934630    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:36:58.006049 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.006012    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-cert\" (UniqueName: \"kubernetes.io/secret/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-cert\") pod \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\" (UID: \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\") "
Oct 31 07:36:58.006255 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.006068    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-kube-api-access-qnhgh\" (UniqueName: \"kubernetes.io/projected/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-kube-api-access-qnhgh\") pod \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\" (UID: \"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2\") "
Oct 31 07:36:58.008259 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.008226    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-cert" pod "c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" (UID: "c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:36:58.008381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.008342    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-kube-api-access-qnhgh" pod "c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" (UID: "c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2"). InnerVolumeSpecName "kube-api-access-qnhgh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:36:58.107711 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.107675    5039 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:58.107711 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.107706    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qnhgh\" (UniqueName: \"kubernetes.io/projected/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2-kube-api-access-qnhgh\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:36:58.695949 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:36:58.695897    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:36:58.783090 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.783053    5039 generic.go:356] "Generic (PLEG): container finished" podID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" containerID="9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63" exitCode=0
Oct 31 07:36:58.783261 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.783098    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"
Oct 31 07:36:58.783261 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.783139    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j" event={"ID":"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2","Type":"ContainerDied","Data":"9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63"}
Oct 31 07:36:58.783261 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.783196    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j" event={"ID":"c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2","Type":"ContainerDied","Data":"f32c14d8e7be758461edd219337c5a819bc44c5c812ea81d7e5a106e90f8934b"}
Oct 31 07:36:58.783261 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.783228    5039 scope.go:122] "RemoveContainer" containerID="9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63"
Oct 31 07:36:58.792897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.792877    5039 scope.go:122] "RemoveContainer" containerID="b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861"
Oct 31 07:36:58.801986 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.801963    5039 scope.go:122] "RemoveContainer" containerID="9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63"
Oct 31 07:36:58.802261 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:36:58.802239    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63\": container with ID starting with 9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63 not found: ID does not exist" containerID="9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63"
Oct 31 07:36:58.802347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.802271    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63"} err="failed to get container status \"9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63\": rpc error: code = NotFound desc = could not find container \"9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63\": container with ID starting with 9c1da3a5b7d91933aada1c21881f28d165fc4ede9eb3ca44176071bfd34b4d63 not found: ID does not exist"
Oct 31 07:36:58.802347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.802289    5039 scope.go:122] "RemoveContainer" containerID="b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861"
Oct 31 07:36:58.802557 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:36:58.802535    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861\": container with ID starting with b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861 not found: ID does not exist" containerID="b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861"
Oct 31 07:36:58.802598 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.802565    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861"} err="failed to get container status \"b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861\": rpc error: code = NotFound desc = could not find container \"b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861\": container with ID starting with b18f08ab804fccee45444d191c180c544ffe45f3b131a698dbe38cfc71dfb861 not found: ID does not exist"
Oct 31 07:36:58.830879 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.830848    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"]
Oct 31 07:36:58.841876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:58.841848    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-rw52j"]
Oct 31 07:36:59.614874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:36:59.614837    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" path="/var/lib/kubelet/pods/c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2/volumes"
Oct 31 07:37:05.799403 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:05.799365    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:05.996332 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:05.996286    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:06.190067 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:06.190026    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:06.392115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:06.392028    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:06.622814 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:06.622775    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:06.870315 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:06.870258    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:07.208952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:07.208905    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:07.713678 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:07.713647    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:08.483707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:08.483667    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:08.769236 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:08.769130    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:09.991250 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:09.991217    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:10.893351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:10.893313    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:15.311057 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:15.311019    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:16.697279 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:16.697241    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:18.949643 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:18.949610    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:19.379075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:19.379008    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:21.087270 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:21.087230    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:22.851883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:22.851831    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:24.570504 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:24.570446    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:28.695876 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:37:28.695837    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:37:29.855268 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:29.855232    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:31.556743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:31.556706    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:33.315747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:33.315707    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:35.968568 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:35.968527    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:50.927992 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.927722    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5fdb76d5d4-wm9p4"]
Oct 31 07:37:50.928564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.928417    5039 cpu_manager.go:414] "containerMap: removing container" podUID="f4160592-698b-4b73-a462-b69ff36a5927" containerName="maas-api"
Oct 31 07:37:50.928564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.928443    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4160592-698b-4b73-a462-b69ff36a5927" containerName="maas-api"
Oct 31 07:37:50.928564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.928496    5039 cpu_manager.go:414] "containerMap: removing container" podUID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" containerName="manager"
Oct 31 07:37:50.928564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.928507    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" containerName="manager"
Oct 31 07:37:50.928564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.928522    5039 cpu_manager.go:414] "containerMap: removing container" podUID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" containerName="manager"
Oct 31 07:37:50.928564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.928529    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" containerName="manager"
Oct 31 07:37:50.928868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.928665    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" containerName="manager"
Oct 31 07:37:50.928868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.928679    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6b4769e-14be-41e8-ab5d-0b22bdf1c4f2" containerName="manager"
Oct 31 07:37:50.928868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.928695    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4160592-698b-4b73-a462-b69ff36a5927" containerName="maas-api"
Oct 31 07:37:50.931784 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.931761    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4"
Oct 31 07:37:50.948743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.948716    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fdb76d5d4-wm9p4"]
Oct 31 07:37:50.990546 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.990510    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d82261f3-4787-4a3a-aa06-c082ffb2116e-tls-cert\") pod \"authorino-5fdb76d5d4-wm9p4\" (UID: \"d82261f3-4787-4a3a-aa06-c082ffb2116e\") " pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4"
Oct 31 07:37:50.990723 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:50.990589    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx2vg\" (UniqueName: \"kubernetes.io/projected/d82261f3-4787-4a3a-aa06-c082ffb2116e-kube-api-access-xx2vg\") pod \"authorino-5fdb76d5d4-wm9p4\" (UID: \"d82261f3-4787-4a3a-aa06-c082ffb2116e\") " pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4"
Oct 31 07:37:51.091289 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:51.091255    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx2vg\" (UniqueName: \"kubernetes.io/projected/d82261f3-4787-4a3a-aa06-c082ffb2116e-kube-api-access-xx2vg\") pod \"authorino-5fdb76d5d4-wm9p4\" (UID: \"d82261f3-4787-4a3a-aa06-c082ffb2116e\") " pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4"
Oct 31 07:37:51.091451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:51.091365    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d82261f3-4787-4a3a-aa06-c082ffb2116e-tls-cert\") pod \"authorino-5fdb76d5d4-wm9p4\" (UID: \"d82261f3-4787-4a3a-aa06-c082ffb2116e\") " pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4"
Oct 31 07:37:51.093813 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:51.093788    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d82261f3-4787-4a3a-aa06-c082ffb2116e-tls-cert\") pod \"authorino-5fdb76d5d4-wm9p4\" (UID: \"d82261f3-4787-4a3a-aa06-c082ffb2116e\") " pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4"
Oct 31 07:37:51.110887 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:51.110853    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx2vg\" (UniqueName: \"kubernetes.io/projected/d82261f3-4787-4a3a-aa06-c082ffb2116e-kube-api-access-xx2vg\") pod \"authorino-5fdb76d5d4-wm9p4\" (UID: \"d82261f3-4787-4a3a-aa06-c082ffb2116e\") " pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4"
Oct 31 07:37:51.244319 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:51.244282    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4"
Oct 31 07:37:51.539773 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:51.539673    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fdb76d5d4-wm9p4"]
Oct 31 07:37:51.543944 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:37:51.543897    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd82261f3_4787_4a3a_aa06_c082ffb2116e.slice/crio-835fb2389d28535934c6c0868a318925a4be4f5db433062ed524f72e5d9bfd86 WatchSource:0}: Error finding container 835fb2389d28535934c6c0868a318925a4be4f5db433062ed524f72e5d9bfd86: Status 404 returned error can't find the container with id 835fb2389d28535934c6c0868a318925a4be4f5db433062ed524f72e5d9bfd86
Oct 31 07:37:52.099255 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:52.099226    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4" event={"ID":"d82261f3-4787-4a3a-aa06-c082ffb2116e","Type":"ContainerStarted","Data":"835fb2389d28535934c6c0868a318925a4be4f5db433062ed524f72e5d9bfd86"}
Oct 31 07:37:53.112627 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.112588    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4" event={"ID":"d82261f3-4787-4a3a-aa06-c082ffb2116e","Type":"ContainerStarted","Data":"462fd4e7b8eba81cb07cd88f16337addcd289223921a0beaf5ebd65428e4e8fc"}
Oct 31 07:37:53.149880 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.149822    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5fdb76d5d4-wm9p4" podStartSLOduration=2.659281281 podStartE2EDuration="3.149805792s" totalImagesPullingTime="490.524511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:53.148154249 +0000 UTC m=+587.677348924" watchObservedRunningTime="2026-10-31 07:37:53.149805792 +0000 UTC m=+587.679000465"
Oct 31 07:37:53.182642 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.182574    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-594f9d5b5f-ntsb4"]
Oct 31 07:37:53.183218 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.183156    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4" podUID="5d623fce-e9e8-4ecf-893d-104507d22f6a" containerName="authorino" containerID="cri-o://cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd" gracePeriod=30
Oct 31 07:37:53.478519 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.478491    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:37:53.617340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.617307    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5d623fce-e9e8-4ecf-893d-104507d22f6a-tls-cert\" (UniqueName: \"kubernetes.io/secret/5d623fce-e9e8-4ecf-893d-104507d22f6a-tls-cert\") pod \"5d623fce-e9e8-4ecf-893d-104507d22f6a\" (UID: \"5d623fce-e9e8-4ecf-893d-104507d22f6a\") "
Oct 31 07:37:53.617483 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.617435    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5d623fce-e9e8-4ecf-893d-104507d22f6a-kube-api-access-mxcmm\" (UniqueName: \"kubernetes.io/projected/5d623fce-e9e8-4ecf-893d-104507d22f6a-kube-api-access-mxcmm\") pod \"5d623fce-e9e8-4ecf-893d-104507d22f6a\" (UID: \"5d623fce-e9e8-4ecf-893d-104507d22f6a\") "
Oct 31 07:37:53.619749 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.619665    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d623fce-e9e8-4ecf-893d-104507d22f6a-kube-api-access-mxcmm" pod "5d623fce-e9e8-4ecf-893d-104507d22f6a" (UID: "5d623fce-e9e8-4ecf-893d-104507d22f6a"). InnerVolumeSpecName "kube-api-access-mxcmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:37:53.628218 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.628184    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d623fce-e9e8-4ecf-893d-104507d22f6a-tls-cert" pod "5d623fce-e9e8-4ecf-893d-104507d22f6a" (UID: "5d623fce-e9e8-4ecf-893d-104507d22f6a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:37:53.690549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.690515    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:53.719055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.718997    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxcmm\" (UniqueName: \"kubernetes.io/projected/5d623fce-e9e8-4ecf-893d-104507d22f6a-kube-api-access-mxcmm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:37:53.719055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.719029    5039 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5d623fce-e9e8-4ecf-893d-104507d22f6a-tls-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:37:53.885980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:53.885881    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:54.119856 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:54.119817    5039 generic.go:356] "Generic (PLEG): container finished" podID="5d623fce-e9e8-4ecf-893d-104507d22f6a" containerID="cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd" exitCode=0
Oct 31 07:37:54.120350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:54.119879    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4"
Oct 31 07:37:54.120350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:54.119904    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4" event={"ID":"5d623fce-e9e8-4ecf-893d-104507d22f6a","Type":"ContainerDied","Data":"cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd"}
Oct 31 07:37:54.120350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:54.119964    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-594f9d5b5f-ntsb4" event={"ID":"5d623fce-e9e8-4ecf-893d-104507d22f6a","Type":"ContainerDied","Data":"84a71ab3d2dfda54dbab339d2f91c3ce825520c9d85867724e3592f6c90525b0"}
Oct 31 07:37:54.120350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:54.119991    5039 scope.go:122] "RemoveContainer" containerID="cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd"
Oct 31 07:37:54.138744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:54.138721    5039 scope.go:122] "RemoveContainer" containerID="cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd"
Oct 31 07:37:54.139096 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:37:54.139068    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd\": container with ID starting with cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd not found: ID does not exist" containerID="cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd"
Oct 31 07:37:54.139162 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:54.139109    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd"} err="failed to get container status \"cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd\": rpc error: code = NotFound desc = could not find container \"cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd\": container with ID starting with cb1fd5b2efdb4dad92f83c1093989502569ab3980033aa497493d5ebf24b14dd not found: ID does not exist"
Oct 31 07:37:54.171570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:54.171539    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-594f9d5b5f-ntsb4"]
Oct 31 07:37:54.173818 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:54.173792    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-594f9d5b5f-ntsb4"]
Oct 31 07:37:55.616537 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:55.616497    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5d623fce-e9e8-4ecf-893d-104507d22f6a" path="/var/lib/kubelet/pods/5d623fce-e9e8-4ecf-893d-104507d22f6a/volumes"
Oct 31 07:37:56.026201 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.026164    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"]
Oct 31 07:37:56.026618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.026602    5039 cpu_manager.go:414] "containerMap: removing container" podUID="5d623fce-e9e8-4ecf-893d-104507d22f6a" containerName="authorino"
Oct 31 07:37:56.026693 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.026619    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5d623fce-e9e8-4ecf-893d-104507d22f6a" containerName="authorino"
Oct 31 07:37:56.026737 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.026716    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="5d623fce-e9e8-4ecf-893d-104507d22f6a" containerName="authorino"
Oct 31 07:37:56.031104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.031079    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.059787 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.059752    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"]
Oct 31 07:37:56.143656 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.143620    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.143656 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.143661    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.143872 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.143691    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.143872 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.143825    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.143976 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.143934    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.144021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.144006    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.144060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.144049    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.144112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.144093    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddtq4\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-kube-api-access-ddtq4\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.144165 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.144153    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.245385 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245347    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.245385 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245395    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.245635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245415    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddtq4\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-kube-api-access-ddtq4\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.245635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245439    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.245635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245472    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.245635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245495    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.245635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245521    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.245635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245552    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.245635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245608    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.246214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.245890    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.246214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.246197    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.246320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.246236    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.246320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.246238    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.246320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.246279    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.248041 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.248018    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.248441 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.248424    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.265864 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.265800    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.268378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.268321    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddtq4\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-kube-api-access-ddtq4\") pod \"maas-default-gateway-openshift-default-645cf464d7-qrlhn\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.352403 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.352051    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:56.678196 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.678105    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"]
Oct 31 07:37:56.681867 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:37:56.681834    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a62bb58_a916_47ac_94ff_c2c9f3440fbc.slice/crio-3c8c1795420f1f034bd039968fbe04cd85b3193c831a22efe80973318a334f63 WatchSource:0}: Error finding container 3c8c1795420f1f034bd039968fbe04cd85b3193c831a22efe80973318a334f63: Status 404 returned error can't find the container with id 3c8c1795420f1f034bd039968fbe04cd85b3193c831a22efe80973318a334f63
Oct 31 07:37:56.684133 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.684101    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:37:56.684213 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.684200    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:37:56.684261 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:56.684232    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:37:57.139466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:57.139419    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" event={"ID":"0a62bb58-a916-47ac-94ff-c2c9f3440fbc","Type":"ContainerStarted","Data":"46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f"}
Oct 31 07:37:57.139640 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:57.139497    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" event={"ID":"0a62bb58-a916-47ac-94ff-c2c9f3440fbc","Type":"ContainerStarted","Data":"3c8c1795420f1f034bd039968fbe04cd85b3193c831a22efe80973318a334f63"}
Oct 31 07:37:57.224902 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:57.224842    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podStartSLOduration=1.224827418 podStartE2EDuration="1.224827418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:37:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:37:57.213005531 +0000 UTC m=+591.742200202" watchObservedRunningTime="2026-10-31 07:37:57.224827418 +0000 UTC m=+591.754022092"
Oct 31 07:37:57.360937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:57.358903    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:37:57.360937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:57.359063    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 07:37:57.360937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:57.359110    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 07:37:57.976240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:57.976195    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:58.177079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:58.177011    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:37:58.375007 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:58.374042    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 07:37:58.375007 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:58.374121    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 07:37:58.700313 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:37:58.700216    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:37:59.355943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:59.355389    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 07:37:59.355943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:37:59.355455    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 07:38:00.356941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:00.355351    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 07:38:00.356941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:00.355433    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 07:38:01.359195 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:01.359154    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 07:38:01.359775 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:01.359725    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 07:38:02.370955 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:02.364383    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 07:38:02.370955 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:02.364453    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 07:38:03.353618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:03.353578    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Oct 31 07:38:03.353795 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:03.353663    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Oct 31 07:38:05.353964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:05.353883    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:38:05.354479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:05.353992    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:38:05.680765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:05.680669    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:38:05.682219 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:05.682192    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:38:05.693788 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:05.693758    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:38:05.694905 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:05.694878    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:38:05.866716 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:05.866679    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:06.395199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:06.395134    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:38:06.395799 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:06.395236    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:38:07.078342 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:07.078303    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:38:07.078980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:07.078957    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:38:07.079796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:07.079775    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 07:38:11.001910 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:11.001873    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:17.935550 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:17.935512    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:18.592388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:18.592347    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:23.269321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:23.269262    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:23.762273 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:23.762237    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:25.354536 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:25.354501    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:25.551461 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:25.551422    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:26.874215 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:26.874178    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:27.061131 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:27.061095    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:28.696575 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:38:28.696538    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:38:42.264197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:42.264161    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:47.198779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:47.198742    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:47.386836 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:47.386800    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:47.704373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:47.704339    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:47.909638 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:47.909606    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:48.013436 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.013354    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"]
Oct 31 07:38:48.018735 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.018708    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.030966 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.030935    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"]
Oct 31 07:38:48.074623 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.074583    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-3dff3f-openshift-default-dockercfg-8q5cz\""
Oct 31 07:38:48.098715 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.098666    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.098967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.098742    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9cxl\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-kube-api-access-x9cxl\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.098967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.098766    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.098967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.098789    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.098967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.098895    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.099214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.099028    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.099214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.099064    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.099214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.099086    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.099214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.099152    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e932f2-848b-40ca-b59d-d77bc8e6090d-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.100463 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.100441    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:48.199812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.199754    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.199836    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.199871    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200029    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e932f2-848b-40ca-b59d-d77bc8e6090d-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200118    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200149    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9cxl\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-kube-api-access-x9cxl\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200180    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200211    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200254    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200257    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200520    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200582    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.200811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.200779    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.201262 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.201237    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e932f2-848b-40ca-b59d-d77bc8e6090d-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.202350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.202325    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.203500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.203480    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.221263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.221228    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.222382 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.222350    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9cxl\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-kube-api-access-x9cxl\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.297663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.297562    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:48.342750 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.342707    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:48.367587 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.367549    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"]
Oct 31 07:38:48.372551 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.372147    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.396307 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.396281    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-4794f5-openshift-default-dockercfg-lqf5r\""
Oct 31 07:38:48.401368 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.401122    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"]
Oct 31 07:38:48.505939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.505514    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.505939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.505596    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.505939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.505620    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.505939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.505658    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.505939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.505700    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.505939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.505736    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.505939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.505766    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnnm\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-kube-api-access-slnnm\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.505939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.505795    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.505939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.505828    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.511878 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.511705    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.607226    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slnnm\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-kube-api-access-slnnm\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.607278    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.607311    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.607377    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.607446    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.607470    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.607501    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.607548    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.607590    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.608039    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.608077    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.608714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.608311    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.609828 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.609367    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.609828 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.609641    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.610998 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.610946    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.611819 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.611795    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.625470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.625440    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.625470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.625461    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnnm\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-kube-api-access-slnnm\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.692180 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.692148    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:48.707350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.707315    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"]
Oct 31 07:38:48.711066 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:38:48.711036    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e932f2_848b_40ca_b59d_d77bc8e6090d.slice/crio-ac9ec14976bcc12bc8bc82826e489e721d9ffcad070fdfd8208a8ce5284fd1f2 WatchSource:0}: Error finding container ac9ec14976bcc12bc8bc82826e489e721d9ffcad070fdfd8208a8ce5284fd1f2: Status 404 returned error can't find the container with id ac9ec14976bcc12bc8bc82826e489e721d9ffcad070fdfd8208a8ce5284fd1f2
Oct 31 07:38:48.713078 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.713050    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:48.713435 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.713405    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:38:48.713508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.713474    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:38:48.713508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.713502    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:38:48.881076 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:48.880990    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:49.047209 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.047174    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"]
Oct 31 07:38:49.052164 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:38:49.052122    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65df80c4_a26b_40c9_b38b_6a71b7935fb8.slice/crio-ed2dd19406b67cc646fc7d3ad94fcaead11954fc1ddfa4dacae00a6042c7da09 WatchSource:0}: Error finding container ed2dd19406b67cc646fc7d3ad94fcaead11954fc1ddfa4dacae00a6042c7da09: Status 404 returned error can't find the container with id ed2dd19406b67cc646fc7d3ad94fcaead11954fc1ddfa4dacae00a6042c7da09
Oct 31 07:38:49.055389 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.055350    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:38:49.055520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.055443    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:38:49.055520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.055483    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:38:49.448609 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.448572    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" event={"ID":"65df80c4-a26b-40c9-b38b-6a71b7935fb8","Type":"ContainerStarted","Data":"4e0e0d5ecf0f80afbf14db5c5360ca06c54eefa1890ea37fb811c4343494c8db"}
Oct 31 07:38:49.449118 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.448627    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" event={"ID":"65df80c4-a26b-40c9-b38b-6a71b7935fb8","Type":"ContainerStarted","Data":"ed2dd19406b67cc646fc7d3ad94fcaead11954fc1ddfa4dacae00a6042c7da09"}
Oct 31 07:38:49.450476 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.450446    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" event={"ID":"40e932f2-848b-40ca-b59d-d77bc8e6090d","Type":"ContainerStarted","Data":"27fd670e8982dd4af04aee4461377b4e5da2c03cc0a12ec6b762efdd2406eaf0"}
Oct 31 07:38:49.450624 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.450492    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" event={"ID":"40e932f2-848b-40ca-b59d-d77bc8e6090d","Type":"ContainerStarted","Data":"ac9ec14976bcc12bc8bc82826e489e721d9ffcad070fdfd8208a8ce5284fd1f2"}
Oct 31 07:38:49.488196 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.488113    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podStartSLOduration=1.488099222 podStartE2EDuration="1.488099222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:49.48620713 +0000 UTC m=+644.015401804" watchObservedRunningTime="2026-10-31 07:38:49.488099222 +0000 UTC m=+644.017293895"
Oct 31 07:38:49.524722 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.524659    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" podStartSLOduration=2.524644738 podStartE2EDuration="2.524644738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:49.523122566 +0000 UTC m=+644.052317239" watchObservedRunningTime="2026-10-31 07:38:49.524644738 +0000 UTC m=+644.053839491"
Oct 31 07:38:49.713428 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:49.713388    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:50.343495 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:50.343453    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:50.348741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:50.348711    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:50.457648 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:50.457611    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:50.458546 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:50.458524    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:38:50.719633 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:50.719595    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:51.138120 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:51.138037    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:51.335199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:51.335162    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:51.463678 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:51.463646    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:51.464653 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:51.464631    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:38:51.628499 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:51.628434    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:51.839525 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:51.839424    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:52.038224 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:52.038180    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:52.236466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:52.236430    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:52.787575 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:52.787518    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:52.993375 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:52.993336    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:53.584776 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:53.584742    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:53.893829 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:53.893736    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:54.265202 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.265155    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:54.476758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.476719    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:54.682674 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.682587    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:54.704352 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.704315    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"]
Oct 31 07:38:54.710137 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.710077    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:38:54.726690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.726664    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"]
Oct 31 07:38:54.773968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.773906    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7g5x\" (UniqueName: \"kubernetes.io/projected/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-kube-api-access-x7g5x\") pod \"payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c\" (UID: \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:38:54.774988 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.774954    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c\" (UID: \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:38:54.776580 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.776559    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w3-3cc201\""
Oct 31 07:38:54.797903 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.797454    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w3-3cc201-dockercfg-f5x2k\""
Oct 31 07:38:54.876123 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.876072    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7g5x\" (UniqueName: \"kubernetes.io/projected/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-kube-api-access-x7g5x\") pod \"payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c\" (UID: \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:38:54.876348 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.876136    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c\" (UID: \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:38:54.876979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.876953    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c\" (UID: \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:38:54.894689 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:54.894656    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7g5x\" (UniqueName: \"kubernetes.io/projected/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-kube-api-access-x7g5x\") pod \"payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c\" (UID: \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:38:55.031295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.031250    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:38:55.302271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.302184    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:55.333976 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.333941    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"]
Oct 31 07:38:55.339818 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:38:55.339781    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0b234c3_44e8_4a22_96a3_c758c7cb8af4.slice/crio-3d419180ac12007eafe0e94b3dde1aab9cb5ee6579674b845349af44e11e71af WatchSource:0}: Error finding container 3d419180ac12007eafe0e94b3dde1aab9cb5ee6579674b845349af44e11e71af: Status 404 returned error can't find the container with id 3d419180ac12007eafe0e94b3dde1aab9cb5ee6579674b845349af44e11e71af
Oct 31 07:38:55.341997 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.341973    5039 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 07:38:55.466388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.466343    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"]
Oct 31 07:38:55.471433 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.471410    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:38:55.487105 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.487073    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c" event={"ID":"d0b234c3-44e8-4a22-96a3-c758c7cb8af4","Type":"ContainerStarted","Data":"3d419180ac12007eafe0e94b3dde1aab9cb5ee6579674b845349af44e11e71af"}
Oct 31 07:38:55.488850 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.488826    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-3dff3f\""
Oct 31 07:38:55.490527 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.490503    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"]
Oct 31 07:38:55.499138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.499116    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-3dff3f-dockercfg-v6bpf\""
Oct 31 07:38:55.511680 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.511649    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:55.581740 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.581636    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b\" (UID: \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:38:55.581894 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.581823    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2dvt\" (UniqueName: \"kubernetes.io/projected/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-kube-api-access-k2dvt\") pod \"payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b\" (UID: \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:38:55.682759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.682709    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2dvt\" (UniqueName: \"kubernetes.io/projected/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-kube-api-access-k2dvt\") pod \"payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b\" (UID: \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:38:55.682941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.682840    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b\" (UID: \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:38:55.683591 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.683566    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b\" (UID: \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:38:55.703621 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.703591    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2dvt\" (UniqueName: \"kubernetes.io/projected/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-kube-api-access-k2dvt\") pod \"payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b\" (UID: \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:38:55.786981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:55.786940    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:38:56.031595 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.029801    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"]
Oct 31 07:38:56.034792 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.034763    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.050986 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.050892    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-027d2a-serving-cert\""
Oct 31 07:38:56.051164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.051112    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4n7bj\""
Oct 31 07:38:56.053083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.052995    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"]
Oct 31 07:38:56.061961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.061575    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 07:38:56.099865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.099830    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:56.112240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.112150    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"]
Oct 31 07:38:56.117222 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:38:56.117188    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ec6f58c_cc28_4dd8_b87f_03085f51a69c.slice/crio-2c582e29773bb6cd9ee01dbd86285db769cd648e7727452f4d603b24d5b12152 WatchSource:0}: Error finding container 2c582e29773bb6cd9ee01dbd86285db769cd648e7727452f4d603b24d5b12152: Status 404 returned error can't find the container with id 2c582e29773bb6cd9ee01dbd86285db769cd648e7727452f4d603b24d5b12152
Oct 31 07:38:56.188791 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.188750    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-metrics-certs\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.189020 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.188904    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-maas-api-tls\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.189088 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.189030    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac8622d-500c-4d62-92b2-4429096ffea6-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.189131 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.189089    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr8bn\" (UniqueName: \"kubernetes.io/projected/7ac8622d-500c-4d62-92b2-4429096ffea6-kube-api-access-vr8bn\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.290150 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.290110    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-maas-api-tls\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.290383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.290190    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac8622d-500c-4d62-92b2-4429096ffea6-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.290383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.290236    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr8bn\" (UniqueName: \"kubernetes.io/projected/7ac8622d-500c-4d62-92b2-4429096ffea6-kube-api-access-vr8bn\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.290383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.290295    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-metrics-certs\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.291378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.291347    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac8622d-500c-4d62-92b2-4429096ffea6-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.293629 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.293600    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-maas-api-tls\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.294318 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.294293    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-metrics-certs\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.296440 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.296384    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:56.308452 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.308421    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr8bn\" (UniqueName: \"kubernetes.io/projected/7ac8622d-500c-4d62-92b2-4429096ffea6-kube-api-access-vr8bn\") pod \"maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.355484 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.355448    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:56.501082 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.500991    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b" event={"ID":"9ec6f58c-cc28-4dd8-b87f-03085f51a69c","Type":"ContainerStarted","Data":"2c582e29773bb6cd9ee01dbd86285db769cd648e7727452f4d603b24d5b12152"}
Oct 31 07:38:56.671189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:56.671083    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"]
Oct 31 07:38:56.675455 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:38:56.675414    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ac8622d_500c_4d62_92b2_4429096ffea6.slice/crio-557e1c550557c5a6bedfb494f380e311331b0f4458075072348771e4b128bebe WatchSource:0}: Error finding container 557e1c550557c5a6bedfb494f380e311331b0f4458075072348771e4b128bebe: Status 404 returned error can't find the container with id 557e1c550557c5a6bedfb494f380e311331b0f4458075072348771e4b128bebe
Oct 31 07:38:57.333655 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:57.333615    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:57.510325 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:57.510279    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7" event={"ID":"7ac8622d-500c-4d62-92b2-4429096ffea6","Type":"ContainerStarted","Data":"0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329"}
Oct 31 07:38:57.510519 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:57.510344    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7" event={"ID":"7ac8622d-500c-4d62-92b2-4429096ffea6","Type":"ContainerStarted","Data":"557e1c550557c5a6bedfb494f380e311331b0f4458075072348771e4b128bebe"}
Oct 31 07:38:57.510519 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:57.510394    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:38:57.542540 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:57.542505    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:57.547783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:57.547722    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7" podStartSLOduration=2.279536868 podStartE2EDuration="2.547707364s" totalImagesPullingTime="268.170496ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:57.547509536 +0000 UTC m=+652.076704207" watchObservedRunningTime="2026-10-31 07:38:57.547707364 +0000 UTC m=+652.076902039"
Oct 31 07:38:57.903457 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:57.903417    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:58.103090 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:58.103053    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:58.518158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:58.518121    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b" event={"ID":"9ec6f58c-cc28-4dd8-b87f-03085f51a69c","Type":"ContainerStarted","Data":"d9c51860abe82c7ba7225d9f2bf05c87c9b6a9f73d366a6424e9a6bfa97498ca"}
Oct 31 07:38:58.518623 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:58.518191    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:38:58.519790 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:58.519760    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c" event={"ID":"d0b234c3-44e8-4a22-96a3-c758c7cb8af4","Type":"ContainerStarted","Data":"485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26"}
Oct 31 07:38:58.519925 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:58.519836    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:38:58.553695 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:58.553645    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b" podStartSLOduration=1.428886688 podStartE2EDuration="3.553632802s" totalImagesPullingTime="2.124746114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:58.55315385 +0000 UTC m=+653.082348526" watchObservedRunningTime="2026-10-31 07:38:58.553632802 +0000 UTC m=+653.082827477"
Oct 31 07:38:58.589852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:58.589793    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c" podStartSLOduration=2.241224011 podStartE2EDuration="4.58977966s" totalImagesPullingTime="2.348555649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:38:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:38:58.588409839 +0000 UTC m=+653.117604507" watchObservedRunningTime="2026-10-31 07:38:58.58977966 +0000 UTC m=+653.118974334"
Oct 31 07:38:58.696819 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:38:58.696777    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:38:58.854155 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:58.854063    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:59.044808 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:59.044772    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:59.606725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:59.606692    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:38:59.796370 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:38:59.796334    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:01.327516 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.327479    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"]
Oct 31 07:39:01.331927 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.331897    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.361151 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.361103    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-3dff3f-serving-cert\""
Oct 31 07:39:01.363314 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.363273    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"]
Oct 31 07:39:01.406333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.406279    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:01.451931 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.451880    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5976e4-eb9b-4e52-b602-196cafb8d10b-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.452114 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.452055    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-metrics-certs\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.452160 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.452105    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpgqq\" (UniqueName: \"kubernetes.io/projected/3e5976e4-eb9b-4e52-b602-196cafb8d10b-kube-api-access-fpgqq\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.452224 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.452209    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-maas-api-tls\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.552809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.552766    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5976e4-eb9b-4e52-b602-196cafb8d10b-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.553060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.552868    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-metrics-certs\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.553060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.552904    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpgqq\" (UniqueName: \"kubernetes.io/projected/3e5976e4-eb9b-4e52-b602-196cafb8d10b-kube-api-access-fpgqq\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.553060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.552978    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-maas-api-tls\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.553634 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.553604    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5976e4-eb9b-4e52-b602-196cafb8d10b-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.555459 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.555431    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-maas-api-tls\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.555570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.555523    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-metrics-certs\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.571528 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.571495    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpgqq\" (UniqueName: \"kubernetes.io/projected/3e5976e4-eb9b-4e52-b602-196cafb8d10b-kube-api-access-fpgqq\") pod \"maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.598173 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.598086    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:01.645691 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.645653    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:01.963836 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:01.963781    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"]
Oct 31 07:39:01.969156 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:39:01.969118    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e5976e4_eb9b_4e52_b602_196cafb8d10b.slice/crio-2dacc38a8396c29afdcb22a981f7ff926ab7a7d5707ee7238209205684aa7d65 WatchSource:0}: Error finding container 2dacc38a8396c29afdcb22a981f7ff926ab7a7d5707ee7238209205684aa7d65: Status 404 returned error can't find the container with id 2dacc38a8396c29afdcb22a981f7ff926ab7a7d5707ee7238209205684aa7d65
Oct 31 07:39:02.546664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:02.546571    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8" event={"ID":"3e5976e4-eb9b-4e52-b602-196cafb8d10b","Type":"ContainerStarted","Data":"105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8"}
Oct 31 07:39:02.546664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:02.546629    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8" event={"ID":"3e5976e4-eb9b-4e52-b602-196cafb8d10b","Type":"ContainerStarted","Data":"2dacc38a8396c29afdcb22a981f7ff926ab7a7d5707ee7238209205684aa7d65"}
Oct 31 07:39:02.547176 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:02.546686    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:02.587258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:02.586741    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8" podStartSLOduration=1.312295853 podStartE2EDuration="1.586723278s" totalImagesPullingTime="274.427425ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:02.586303794 +0000 UTC m=+657.115498468" watchObservedRunningTime="2026-10-31 07:39:02.586723278 +0000 UTC m=+657.115917954"
Oct 31 07:39:03.505749 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:03.505708    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:03.525465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:03.525437    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:39:03.793306 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:03.793209    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:03.981124 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:03.981092    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:05.376279 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:05.376236    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:05.573700 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:05.573669    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:05.945649 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:05.945607    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:06.195948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:06.195841    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:06.522277 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:06.522245    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:06.721852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:06.721821    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:07.133340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.133302    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"]
Oct 31 07:39:07.139098 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.139063    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.158810 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.158773    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"]
Oct 31 07:39:07.186786 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.186749    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-648fbe-serving-cert\""
Oct 31 07:39:07.213159 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.213125    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:07.325453 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.325399    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.325847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.325810    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-maas-api-tls\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.326055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.326024    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw8m5\" (UniqueName: \"kubernetes.io/projected/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-kube-api-access-mw8m5\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.326144 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.326098    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-metrics-certs\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.427316 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.427228    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.427316 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.427289    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-maas-api-tls\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.427316 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.427311    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8m5\" (UniqueName: \"kubernetes.io/projected/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-kube-api-access-mw8m5\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.427552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.427349    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-metrics-certs\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.428248 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.428210    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.430126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.430098    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-metrics-certs\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.430251 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.430139    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-maas-api-tls\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.446664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.446626    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw8m5\" (UniqueName: \"kubernetes.io/projected/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-kube-api-access-mw8m5\") pod \"maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.455336 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.455299    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:07.460073 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.460045    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:07.768554 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:07.768510    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"]
Oct 31 07:39:07.773568 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:39:07.773535    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f1ec49_263c_46e5_bbb8_fd9d78d5651a.slice/crio-156333281e3c890b9f053c22e608b6be313cb985ede973e590a12f5842ec68b2 WatchSource:0}: Error finding container 156333281e3c890b9f053c22e608b6be313cb985ede973e590a12f5842ec68b2: Status 404 returned error can't find the container with id 156333281e3c890b9f053c22e608b6be313cb985ede973e590a12f5842ec68b2
Oct 31 07:39:08.559555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:08.559522    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:39:08.596181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:08.596145    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq" event={"ID":"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a","Type":"ContainerStarted","Data":"a4b44b75ed0c4c86f3f997d8c709661225b765bab7a805c3a3a1d468eb363b61"}
Oct 31 07:39:08.596342 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:08.596200    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq" event={"ID":"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a","Type":"ContainerStarted","Data":"156333281e3c890b9f053c22e608b6be313cb985ede973e590a12f5842ec68b2"}
Oct 31 07:39:08.596342 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:08.596297    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:08.644969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:08.642534    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq" podStartSLOduration=1.360207653 podStartE2EDuration="1.642515515s" totalImagesPullingTime="282.307862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:08.64001193 +0000 UTC m=+663.169206610" watchObservedRunningTime="2026-10-31 07:39:08.642515515 +0000 UTC m=+663.171710190"
Oct 31 07:39:09.089747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:09.089714    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:09.529792 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:09.529753    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:39:09.530027 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:09.529830    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:39:10.100667 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.100634    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"]
Oct 31 07:39:10.104891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.104861    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.120018 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.119969    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-3cc201\"/\"kube-root-ca.crt\""
Oct 31 07:39:10.120153 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.120049    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-3cc201\"/\"openshift-service-ca.crt\""
Oct 31 07:39:10.120329 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.120310    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-3cc201\"/\"simulator-w3-3cc201-kserve-self-signed-certs\""
Oct 31 07:39:10.120418 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.120326    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-3cc201\"/\"default-dockercfg-j99g8\""
Oct 31 07:39:10.122655 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.122630    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"]
Oct 31 07:39:10.139488 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.139466    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:10.266983 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.266946    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-home\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.267158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.267024    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tls-certs\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.267158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.267119    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24lwq\" (UniqueName: \"kubernetes.io/projected/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-kube-api-access-24lwq\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.267158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.267153    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tmp-dir\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.267257 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.267222    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-model-cache\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.267316 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.267303    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-dshm\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.368254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.368166    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tls-certs\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.368254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.368223    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24lwq\" (UniqueName: \"kubernetes.io/projected/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-kube-api-access-24lwq\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.368254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.368251    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tmp-dir\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.368501 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.368292    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-model-cache\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.368501 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.368375    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-dshm\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.368501 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.368407    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-home\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.368738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.368708    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tmp-dir\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.368738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.368728    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-model-cache\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.368947 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.368809    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-home\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.370629 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.370608    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-dshm\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.370807 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.370791    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tls-certs\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.385882 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.385856    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-24lwq\" (UniqueName: \"kubernetes.io/projected/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-kube-api-access-24lwq\") pod \"simulator-w3-3cc201-kserve-745bc8694-8t4ds\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") " pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.423960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.422224    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:10.686309 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.686229    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:10.727046 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:10.727016    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"]
Oct 31 07:39:10.730901 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:39:10.730875    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7eccebf7_2bb0_4a5b_8ac6_4e7b04a6e5b2.slice/crio-98d9bb8a1cd056e9a03ba4b56f70e239d3ccb2f801b2bbcf4d55633f785bd25e WatchSource:0}: Error finding container 98d9bb8a1cd056e9a03ba4b56f70e239d3ccb2f801b2bbcf4d55633f785bd25e: Status 404 returned error can't find the container with id 98d9bb8a1cd056e9a03ba4b56f70e239d3ccb2f801b2bbcf4d55633f785bd25e
Oct 31 07:39:11.123031 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:11.122908    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:11.322895 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:11.322817    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:11.618885 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:11.618847    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" event={"ID":"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2","Type":"ContainerStarted","Data":"98d9bb8a1cd056e9a03ba4b56f70e239d3ccb2f801b2bbcf4d55633f785bd25e"}
Oct 31 07:39:11.760531 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:11.760468    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:11.988980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:11.987765    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:12.575932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:12.575892    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:12.627391 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:12.627358    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" event={"ID":"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2","Type":"ContainerStarted","Data":"2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0"}
Oct 31 07:39:12.670629 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:12.670562    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podStartSLOduration=1.48495827 podStartE2EDuration="2.670542073s" totalImagesPullingTime="1.185583803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:12.667385045 +0000 UTC m=+667.196579719" watchObservedRunningTime="2026-10-31 07:39:12.670542073 +0000 UTC m=+667.199736748"
Oct 31 07:39:13.429486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:13.429447    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:14.608795 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:14.608753    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:39:14.610346 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:14.610296    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:14.804869 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:14.804840    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:16.390458 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:16.390366    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:17.376815 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:17.376776    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:17.948114 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:17.948065    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:18.165941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:18.160344    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:19.968941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:19.965385    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:20.423555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:20.423466    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:20.440229 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:20.440196    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:20.717366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:20.717333    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:39:21.559881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:21.559830    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:22.100426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.100391    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:22.514110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.514067    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:39:22.514320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.514158    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:39:22.595779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.595734    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"]
Oct 31 07:39:22.600124 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.600093    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.625617 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.625581    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-027d2a\"/\"kube-root-ca.crt\""
Oct 31 07:39:22.626131 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.625988    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-027d2a\"/\"openshift-service-ca.crt\""
Oct 31 07:39:22.626131 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.626098    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-027d2a\"/\"simulator-w6-027d2a-kserve-self-signed-certs\""
Oct 31 07:39:22.628901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.628863    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-027d2a\"/\"default-dockercfg-jktgf\""
Oct 31 07:39:22.631226 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.631201    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"]
Oct 31 07:39:22.646719 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.646693    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:22.679938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.678613    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p8wh\" (UniqueName: \"kubernetes.io/projected/4a4c11ea-036c-4a3c-8d48-f484a49d152d-kube-api-access-8p8wh\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.679938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.678749    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tmp-dir\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.679938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.678846    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-dshm\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.679938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.678957    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-home\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.679938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.679015    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-model-cache\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.679938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.679047    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tls-certs\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.782534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.782437    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-dshm\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.782534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.782521    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-home\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.782777 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.782558    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-model-cache\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.782777 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.782586    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tls-certs\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.782777 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.782625    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p8wh\" (UniqueName: \"kubernetes.io/projected/4a4c11ea-036c-4a3c-8d48-f484a49d152d-kube-api-access-8p8wh\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.782777 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.782696    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tmp-dir\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.783068 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.783038    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-home\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.783163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.783138    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tmp-dir\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.783755 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.783728    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-model-cache\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.785859 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.785769    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-dshm\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.786387 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.786355    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tls-certs\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.802472 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.802434    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p8wh\" (UniqueName: \"kubernetes.io/projected/4a4c11ea-036c-4a3c-8d48-f484a49d152d-kube-api-access-8p8wh\") pod \"simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") " pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:22.918107 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:22.918070    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:23.240711 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.240614    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"]
Oct 31 07:39:23.243701 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:39:23.243665    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a4c11ea_036c_4a3c_8d48_f484a49d152d.slice/crio-7310f53037b627a7d42b29bf69df99c531ca33d6de5476bf86eec3ceaa6923d7 WatchSource:0}: Error finding container 7310f53037b627a7d42b29bf69df99c531ca33d6de5476bf86eec3ceaa6923d7: Status 404 returned error can't find the container with id 7310f53037b627a7d42b29bf69df99c531ca33d6de5476bf86eec3ceaa6923d7
Oct 31 07:39:23.533318 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.533283    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:23.729690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.729654    5039 generic.go:356] "Generic (PLEG): container finished" podID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerID="4e0e0d5ecf0f80afbf14db5c5360ca06c54eefa1890ea37fb811c4343494c8db" exitCode=0
Oct 31 07:39:23.730189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.729733    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" event={"ID":"65df80c4-a26b-40c9-b38b-6a71b7935fb8","Type":"ContainerDied","Data":"4e0e0d5ecf0f80afbf14db5c5360ca06c54eefa1890ea37fb811c4343494c8db"}
Oct 31 07:39:23.730189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.730178    5039 scope.go:122] "RemoveContainer" containerID="4e0e0d5ecf0f80afbf14db5c5360ca06c54eefa1890ea37fb811c4343494c8db"
Oct 31 07:39:23.736335 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.736301    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:39:23.736494 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.736392    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:39:23.736494 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.736437    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:39:23.736760 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.736727    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" event={"ID":"4a4c11ea-036c-4a3c-8d48-f484a49d152d","Type":"ContainerStarted","Data":"4be98311397443898707f26d71a8d9761d74bf0aaf84c742eb9f50830b217c88"}
Oct 31 07:39:23.736851 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.736777    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" event={"ID":"4a4c11ea-036c-4a3c-8d48-f484a49d152d","Type":"ContainerStarted","Data":"7310f53037b627a7d42b29bf69df99c531ca33d6de5476bf86eec3ceaa6923d7"}
Oct 31 07:39:23.812744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.812692    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" podStartSLOduration=1.812677088 podStartE2EDuration="1.812677088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:23.810556923 +0000 UTC m=+678.339751608" watchObservedRunningTime="2026-10-31 07:39:23.812677088 +0000 UTC m=+678.341871783"
Oct 31 07:39:23.918283 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.918247    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:23.944148 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:23.944092    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:24.745633 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:24.745591    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" event={"ID":"65df80c4-a26b-40c9-b38b-6a71b7935fb8","Type":"ContainerStarted","Data":"91020480c3c619c829af074fb50ffb0adaddaeea619ab64d1b4917d6ddb4ff90"}
Oct 31 07:39:25.439682 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:25.439634    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:25.713310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:25.713274    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:39:25.713547 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:25.713519    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 31 07:39:25.713618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:25.713593    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 31 07:39:26.713969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:26.713928    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 31 07:39:26.714394 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:26.713989    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 31 07:39:27.073940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.073157    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:27.272871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.272671    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:27.683044 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.682569    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:27.714552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.714507    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 31 07:39:27.714972 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.714569    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 31 07:39:27.785972 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.785899    5039 generic.go:356] "Generic (PLEG): container finished" podID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerID="27fd670e8982dd4af04aee4461377b4e5da2c03cc0a12ec6b762efdd2406eaf0" exitCode=0
Oct 31 07:39:27.786137 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.785980    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" event={"ID":"40e932f2-848b-40ca-b59d-d77bc8e6090d","Type":"ContainerDied","Data":"27fd670e8982dd4af04aee4461377b4e5da2c03cc0a12ec6b762efdd2406eaf0"}
Oct 31 07:39:27.786496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.786473    5039 scope.go:122] "RemoveContainer" containerID="27fd670e8982dd4af04aee4461377b4e5da2c03cc0a12ec6b762efdd2406eaf0"
Oct 31 07:39:27.788151 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.788116    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:39:27.788230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.788213    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:39:27.788279 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.788264    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:39:27.894315 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:27.894282    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:28.714942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:28.714305    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 31 07:39:28.714942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:28.714375    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 31 07:39:28.729188 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:39:28.729152    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:39:28.813730 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:28.813692    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" event={"ID":"40e932f2-848b-40ca-b59d-d77bc8e6090d","Type":"ContainerStarted","Data":"9ac2fd0a101f37400172a25f5b8462db7fe306594efcea537d194fea37420e0d"}
Oct 31 07:39:29.026001 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:29.018550    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:29.343578 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:29.343482    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:39:29.343756 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:29.343593    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 07:39:29.343756 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:29.343630    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 07:39:29.713951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:29.713687    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Oct 31 07:39:29.713951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:29.713793    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Oct 31 07:39:30.344014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:30.343980    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 07:39:30.344408 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:30.344038    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 07:39:30.537203 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:30.537161    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:30.717787 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:30.717755    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:39:30.718182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:30.718162    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:39:30.718947 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:30.718909    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:39:31.344107 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:31.344069    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 07:39:31.344512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:31.344125    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 07:39:31.677370 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:31.677266    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:32.343235 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:32.343194    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 07:39:32.343421 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:32.343268    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 07:39:32.356968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:32.356776    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:32.579932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:32.579876    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:32.801530 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:32.801488    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:32.919016 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:32.918951    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:32.932070 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:32.932038    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:33.014533 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.014486    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:33.344154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.344115    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Oct 31 07:39:33.344330 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.344194    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Oct 31 07:39:33.806686 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.806647    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"]
Oct 31 07:39:33.813968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.813901    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:33.842414 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.842377    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"default-dockercfg-qtnhp\""
Oct 31 07:39:33.842414 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.842403    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"kube-root-ca.crt\""
Oct 31 07:39:33.842685 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.842466    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"openshift-service-ca.crt\""
Oct 31 07:39:33.842685 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.842583    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"simulator-w1-4794f5-kserve-self-signed-certs\""
Oct 31 07:39:33.847316 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.847281    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"]
Oct 31 07:39:33.869362 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.867821    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:33.880501 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.880470    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:39:33.950551 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.950511    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tmp-dir\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:33.950551 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.950555    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tls-certs\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:33.950781 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.950678    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-dshm\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:33.950781 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.950738    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-model-cache\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:33.950865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.950781    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5sqc\" (UniqueName: \"kubernetes.io/projected/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-kube-api-access-k5sqc\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:33.951083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:33.951059    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-home\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.052507 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.052449    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tmp-dir\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.052507 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.052505    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tls-certs\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.052784 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.052562    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-dshm\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.052784 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.052604    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-model-cache\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.052784 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.052643    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5sqc\" (UniqueName: \"kubernetes.io/projected/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-kube-api-access-k5sqc\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.052784 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.052731    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-home\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.053274 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.053244    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-home\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.053367 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.053310    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-model-cache\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.053960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.053882    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tmp-dir\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.056199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.056173    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tls-certs\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.056499 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.056478    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-dshm\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.087340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.086170    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5sqc\" (UniqueName: \"kubernetes.io/projected/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-kube-api-access-k5sqc\") pod \"simulator-w1-4794f5-kserve-74f6db5cf-rvk22\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") " pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.129740 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.129692    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:34.221365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.221332    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:34.348393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.348309    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:39:34.348684 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.348660    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:39:34.349604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.349581    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:39:34.441151 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.441114    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"]
Oct 31 07:39:34.446712 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:39:34.446671    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd344b65_691d_401a_b1af_6c0dd8ae8b7f.slice/crio-07ab9366b57a087fa8422f1d5e17844fe32e1009a6ee9ceecf15d700bd698cc7 WatchSource:0}: Error finding container 07ab9366b57a087fa8422f1d5e17844fe32e1009a6ee9ceecf15d700bd698cc7: Status 404 returned error can't find the container with id 07ab9366b57a087fa8422f1d5e17844fe32e1009a6ee9ceecf15d700bd698cc7
Oct 31 07:39:34.857687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.857630    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" event={"ID":"bd344b65-691d-401a-b1af-6c0dd8ae8b7f","Type":"ContainerStarted","Data":"ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff"}
Oct 31 07:39:34.858233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.857693    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" event={"ID":"bd344b65-691d-401a-b1af-6c0dd8ae8b7f","Type":"ContainerStarted","Data":"07ab9366b57a087fa8422f1d5e17844fe32e1009a6ee9ceecf15d700bd698cc7"}
Oct 31 07:39:34.896219 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:34.896161    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podStartSLOduration=1.896144007 podStartE2EDuration="1.896144007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:34.893591302 +0000 UTC m=+689.422785971" watchObservedRunningTime="2026-10-31 07:39:34.896144007 +0000 UTC m=+689.425338680"
Oct 31 07:39:35.130575 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:35.130482    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:35.922585 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:35.922552    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:37.406132 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:37.406095    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:37.675234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:37.675146    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:38.258484 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:38.258440    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:38.446130 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:38.446093    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:38.912241 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:38.912204    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:40.401749 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:40.401711    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:41.256463 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:41.256419    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:41.908563 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:41.908533    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:43.428887 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:43.428852    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:44.130685 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:44.130643    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:44.144148 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:44.144113    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:44.939633 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:44.939596    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:39:45.075223 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:45.075194    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:46.410900 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.410858    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"]
Oct 31 07:39:46.415980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.415906    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.441255 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.441216    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-3dff3f\"/\"openshift-service-ca.crt\""
Oct 31 07:39:46.441438 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.441286    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-3dff3f\"/\"kube-root-ca.crt\""
Oct 31 07:39:46.441438 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.441331    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-3dff3f\"/\"default-dockercfg-dztn4\""
Oct 31 07:39:46.441438 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.441421    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-3dff3f\"/\"simulator-w4-3dff3f-kserve-self-signed-certs\""
Oct 31 07:39:46.444015 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.443993    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"]
Oct 31 07:39:46.447323 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.447292    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:46.586179 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.586133    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-model-cache\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.586179 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.586174    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8wxg\" (UniqueName: \"kubernetes.io/projected/18a15066-1fa5-40bc-94c5-3252031312c8-kube-api-access-g8wxg\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.586453 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.586201    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-dshm\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.586453 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.586356    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-home\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.586453 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.586403    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-tmp-dir\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.586620 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.586485    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18a15066-1fa5-40bc-94c5-3252031312c8-tls-certs\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.636045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.636009    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:46.690079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.687344    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18a15066-1fa5-40bc-94c5-3252031312c8-tls-certs\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.690079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.687494    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-model-cache\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.690079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.687518    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8wxg\" (UniqueName: \"kubernetes.io/projected/18a15066-1fa5-40bc-94c5-3252031312c8-kube-api-access-g8wxg\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.690079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.687541    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-dshm\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.690079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.687588    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-home\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.690079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.687645    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-tmp-dir\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.690079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.688183    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-tmp-dir\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.690079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.689130    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-model-cache\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.690643 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.690455    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-home\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.697573 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.697538    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18a15066-1fa5-40bc-94c5-3252031312c8-tls-certs\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.703217 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.703181    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-dshm\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.706597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.706568    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8wxg\" (UniqueName: \"kubernetes.io/projected/18a15066-1fa5-40bc-94c5-3252031312c8-kube-api-access-g8wxg\") pod \"simulator-w4-3dff3f-kserve-9b6444689-k4r9x\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") " pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:46.730005 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:46.729965    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:47.029393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:47.029349    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"]
Oct 31 07:39:47.033632 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:39:47.033588    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18a15066_1fa5_40bc_94c5_3252031312c8.slice/crio-382e662564de620b703300853e2dfcac165e2b7f1c07c34d5ba05091492c078d WatchSource:0}: Error finding container 382e662564de620b703300853e2dfcac165e2b7f1c07c34d5ba05091492c078d: Status 404 returned error can't find the container with id 382e662564de620b703300853e2dfcac165e2b7f1c07c34d5ba05091492c078d
Oct 31 07:39:47.947404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:47.947364    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" event={"ID":"18a15066-1fa5-40bc-94c5-3252031312c8","Type":"ContainerStarted","Data":"fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63"}
Oct 31 07:39:47.947903 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:47.947412    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" event={"ID":"18a15066-1fa5-40bc-94c5-3252031312c8","Type":"ContainerStarted","Data":"382e662564de620b703300853e2dfcac165e2b7f1c07c34d5ba05091492c078d"}
Oct 31 07:39:47.985397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:47.985343    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podStartSLOduration=1.985328216 podStartE2EDuration="1.985328216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:39:47.983829572 +0000 UTC m=+702.513024248" watchObservedRunningTime="2026-10-31 07:39:47.985328216 +0000 UTC m=+702.514522890"
Oct 31 07:39:48.113230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:48.113193    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:48.731038 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:48.730997    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:49.158396 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:49.158309    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:49.702157 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:49.702115    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:50.513522 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:50.513475    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:51.295901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:51.295860    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:52.952003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:52.951973    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:54.510815 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:54.510776    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:55.960690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:55.960650    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:56.730297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:56.730265    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:56.743632 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:56.743594    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:57.014657 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:57.014582    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:39:57.477711 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:57.477680    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:58.697423 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:39:58.697374    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:39:58.989316 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:58.989279    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:59.077565 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.077530    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"]
Oct 31 07:39:59.081950 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.081897    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.107586 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.107553    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-027d2a\"/\"premium-w6-027d2a-kserve-self-signed-certs\""
Oct 31 07:39:59.111280 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.111253    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"]
Oct 31 07:39:59.119720 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.119688    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-model-cache\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.119878 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.119736    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6feac23-1388-43c2-97a1-6f208ea245df-tls-certs\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.119878 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.119820    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-dshm\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.120021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.119928    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzsfx\" (UniqueName: \"kubernetes.io/projected/e6feac23-1388-43c2-97a1-6f208ea245df-kube-api-access-kzsfx\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.120021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.119993    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-home\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.120103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.120053    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-tmp-dir\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.177888 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.177851    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:39:59.221199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.221162    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-model-cache\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.221199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.221205    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6feac23-1388-43c2-97a1-6f208ea245df-tls-certs\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.221455 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.221330    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-dshm\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.221455 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.221409    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzsfx\" (UniqueName: \"kubernetes.io/projected/e6feac23-1388-43c2-97a1-6f208ea245df-kube-api-access-kzsfx\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.221567 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.221473    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-home\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.221567 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.221548    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-tmp-dir\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.221674 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.221587    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-model-cache\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.221866 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.221846    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-tmp-dir\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.221997 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.221971    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-home\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.223584 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.223556    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-dshm\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.223818 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.223800    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6feac23-1388-43c2-97a1-6f208ea245df-tls-certs\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.240032 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.239980    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzsfx\" (UniqueName: \"kubernetes.io/projected/e6feac23-1388-43c2-97a1-6f208ea245df-kube-api-access-kzsfx\") pod \"premium-w6-027d2a-kserve-77f56ffb48-74lkt\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") " pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.396700 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.396658    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:39:59.697511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:39:59.697424    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"]
Oct 31 07:39:59.700800 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:39:59.700771    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode6feac23_1388_43c2_97a1_6f208ea245df.slice/crio-bce89f566036597308b7e7daf95cc24889be6abba9a04b2c4ae0675a64aa6185 WatchSource:0}: Error finding container bce89f566036597308b7e7daf95cc24889be6abba9a04b2c4ae0675a64aa6185: Status 404 returned error can't find the container with id bce89f566036597308b7e7daf95cc24889be6abba9a04b2c4ae0675a64aa6185
Oct 31 07:40:00.023214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:00.023177    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" event={"ID":"e6feac23-1388-43c2-97a1-6f208ea245df","Type":"ContainerStarted","Data":"73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1"}
Oct 31 07:40:00.023430 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:00.023227    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" event={"ID":"e6feac23-1388-43c2-97a1-6f208ea245df","Type":"ContainerStarted","Data":"bce89f566036597308b7e7daf95cc24889be6abba9a04b2c4ae0675a64aa6185"}
Oct 31 07:40:00.061109 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:00.061041    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" podStartSLOduration=1.061022696 podStartE2EDuration="1.061022696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:40:00.058816491 +0000 UTC m=+714.588011165" watchObservedRunningTime="2026-10-31 07:40:00.061022696 +0000 UTC m=+714.590217371"
Oct 31 07:40:00.397644 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:00.397564    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:40:00.497607 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:00.497542    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:01.593743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:01.593709    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:02.097435 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:02.097400    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:02.852258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:02.852206    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:03.025710 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:03.025677    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:03.595981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:03.595949    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:05.000961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:05.000929    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:05.373982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:05.373863    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:06.316338 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:06.316300    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:06.633874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:06.633776    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:08.219696 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:08.219655    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:09.397744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:09.397702    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:40:09.410504 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:09.410472    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:40:09.723100 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:09.723068    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:10.110161 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:10.110079    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:40:10.987586 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:10.987553    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:11.184663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.184628    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:11.363317 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.363226    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:11.729263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.728782    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"]
Oct 31 07:40:11.734369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.734342    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.759986 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.759954    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b4e8fd\"/\"openshift-service-ca.crt\""
Oct 31 07:40:11.760262 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.760233    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b4e8fd\"/\"default-dockercfg-hlg77\""
Oct 31 07:40:11.760448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.760250    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-b4e8fd\"/\"kube-root-ca.crt\""
Oct 31 07:40:11.760523 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.760375    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b4e8fd\"/\"premium-w2-b4e8fd-kserve-self-signed-certs\""
Oct 31 07:40:11.763022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.763001    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"]
Oct 31 07:40:11.766820 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.766796    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:11.866893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.866851    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-dshm\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.867093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.866964    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-tmp-dir\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.867188 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.867160    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-home\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.867242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.867204    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcd9z\" (UniqueName: \"kubernetes.io/projected/31be7050-993f-4d04-b410-ed54bebe5704-kube-api-access-hcd9z\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.867301 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.867285    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-model-cache\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.867402 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.867381    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31be7050-993f-4d04-b410-ed54bebe5704-tls-certs\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.968867 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.968818    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-home\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.968867 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.968874    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcd9z\" (UniqueName: \"kubernetes.io/projected/31be7050-993f-4d04-b410-ed54bebe5704-kube-api-access-hcd9z\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.969168 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.968934    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-model-cache\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.969168 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.968988    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31be7050-993f-4d04-b410-ed54bebe5704-tls-certs\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.969168 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.969047    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-dshm\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.969168 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.969094    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-tmp-dir\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.969663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.969607    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-tmp-dir\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.969800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.969709    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-model-cache\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.969874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.969820    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-home\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.971901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.971872    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-dshm\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.972167 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.972141    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31be7050-993f-4d04-b410-ed54bebe5704-tls-certs\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:11.989203 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:11.989126    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcd9z\" (UniqueName: \"kubernetes.io/projected/31be7050-993f-4d04-b410-ed54bebe5704-kube-api-access-hcd9z\") pod \"premium-w2-b4e8fd-kserve-b6c64699-9zb7g\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") " pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:12.047065 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:12.047028    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:12.347057 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:12.346978    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"]
Oct 31 07:40:12.350718 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:40:12.350689    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31be7050_993f_4d04_b410_ed54bebe5704.slice/crio-d99c3b0de496ec3e4c02576e2c6f46f3195a0bbbed3b81c16e8fb6dda945d76f WatchSource:0}: Error finding container d99c3b0de496ec3e4c02576e2c6f46f3195a0bbbed3b81c16e8fb6dda945d76f: Status 404 returned error can't find the container with id d99c3b0de496ec3e4c02576e2c6f46f3195a0bbbed3b81c16e8fb6dda945d76f
Oct 31 07:40:12.719061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:12.719026    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:13.123448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:13.123345    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" event={"ID":"31be7050-993f-4d04-b410-ed54bebe5704","Type":"ContainerStarted","Data":"d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1"}
Oct 31 07:40:13.123448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:13.123393    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" event={"ID":"31be7050-993f-4d04-b410-ed54bebe5704","Type":"ContainerStarted","Data":"d99c3b0de496ec3e4c02576e2c6f46f3195a0bbbed3b81c16e8fb6dda945d76f"}
Oct 31 07:40:13.161857 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:13.161790    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podStartSLOduration=2.16177303 podStartE2EDuration="2.16177303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:40:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:40:13.158640929 +0000 UTC m=+727.687835605" watchObservedRunningTime="2026-10-31 07:40:13.16177303 +0000 UTC m=+727.690967704"
Oct 31 07:40:14.047522 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:14.047490    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:14.329505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:14.329403    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:15.925607 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:15.925572    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:17.502287 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:17.502253    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:18.919220 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:18.919185    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:20.314626 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:20.314593    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:21.161494 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:21.161460    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:21.983197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:21.983165    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:22.047673 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:22.047632    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:22.064713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:22.064681    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:22.198553 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:22.198526    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:40:23.514164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:23.514127    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:24.935097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:24.935058    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:26.254424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:26.254387    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:26.628015 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:26.627932    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:28.241337 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:28.241284    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:28.737480 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:40:28.737436    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:40:29.869685 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:29.869646    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:31.402470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:31.402432    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:32.899329 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:32.899295    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:34.409129 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:34.409081    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:35.934354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:35.934274    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:37.649535 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:37.649501    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:39.364898 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:39.364861    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:40.923963 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:40.923931    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:42.472545 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:42.472457    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:44.205450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:44.205413    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:45.830263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:45.830147    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:47.424670 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:47.424620    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:48.917370 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:48.917319    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:50.536237 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:50.536195    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:52.122783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:52.122732    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:53.646156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:53.646121    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:55.250069 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:55.249997    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:56.714254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:56.714214    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:58.203978 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:58.203943    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:40:58.698877 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:40:58.698783    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:40:59.605335 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:40:59.605297    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:01.225938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:01.224577    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:02.931655 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:02.931623    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:03.256361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.256322    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"]
Oct 31 07:41:03.260332 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.260307    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.274426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.274405    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-b4e8fd-openshift-default-dockercfg-v2jcn\""
Oct 31 07:41:03.280646 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.280615    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn7bs\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-kube-api-access-rn7bs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.280768 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.280660    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.280768 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.280692    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.280875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.280785    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.280958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.280902    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.280958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.280932    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.281066 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.280993    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.281066 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.281031    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fd74f30-bf87-4e02-b77c-b23535f4b943-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.281170 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.281143    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.290581 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.290551    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"]
Oct 31 07:41:03.382093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382049    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fd74f30-bf87-4e02-b77c-b23535f4b943-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.382297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382144    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.382297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382176    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7bs\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-kube-api-access-rn7bs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.382297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382197    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.382297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382215    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.382297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382266    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.382586 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382313    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.382645 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382578    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.382703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382639    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.383028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382848    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.383028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382929    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fd74f30-bf87-4e02-b77c-b23535f4b943-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.383028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.382997    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.383028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.383012    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.383333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.383104    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.384892 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.384868    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.385278 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.385254    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.400640 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.400606    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.401021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.400998    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn7bs\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-kube-api-access-rn7bs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.574549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.574474    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:03.899413 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.899324    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"]
Oct 31 07:41:03.902771 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:41:03.902736    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd74f30_bf87_4e02_b77c_b23535f4b943.slice/crio-31629935c544ac41bca775b8dde93409b0fa5fb09ad2d2265877be5734929330 WatchSource:0}: Error finding container 31629935c544ac41bca775b8dde93409b0fa5fb09ad2d2265877be5734929330: Status 404 returned error can't find the container with id 31629935c544ac41bca775b8dde93409b0fa5fb09ad2d2265877be5734929330
Oct 31 07:41:03.905319 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.905283    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:41:03.905435 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.905364    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:41:03.905435 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:03.905414    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:41:04.488560 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:04.488521    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" event={"ID":"3fd74f30-bf87-4e02-b77c-b23535f4b943","Type":"ContainerStarted","Data":"897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d"}
Oct 31 07:41:04.489038 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:04.488575    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" event={"ID":"3fd74f30-bf87-4e02-b77c-b23535f4b943","Type":"ContainerStarted","Data":"31629935c544ac41bca775b8dde93409b0fa5fb09ad2d2265877be5734929330"}
Oct 31 07:41:04.530087 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:04.530050    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:04.541420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:04.541352    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podStartSLOduration=1.5413361559999998 podStartE2EDuration="1.541336156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:41:04.538389418 +0000 UTC m=+779.067584091" watchObservedRunningTime="2026-10-31 07:41:04.541336156 +0000 UTC m=+779.070530831"
Oct 31 07:41:04.575448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:04.575414    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:04.577057 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:04.577031    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 31 07:41:04.577169 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:04.577077    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 31 07:41:05.576383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:05.576346    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 31 07:41:05.576793 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:05.576399    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 31 07:41:06.088481 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:06.088444    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:06.439472 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:06.439379    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:06.575419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:06.575381    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 31 07:41:06.575713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:06.575684    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 31 07:41:07.528025 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:07.527987    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:07.576480 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:07.576436    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 31 07:41:07.577151 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:07.577114    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 31 07:41:08.576575 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:08.576535    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 31 07:41:08.577253 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:08.577208    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 31 07:41:09.076118 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:09.076074    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:09.578942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:09.578374    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 31 07:41:09.578942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:09.578460    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 31 07:41:10.575166 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:10.575120    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body=
Oct 31 07:41:10.575381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:10.575211    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused"
Oct 31 07:41:10.620822 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:10.620782    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:11.110548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:11.110509    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:11.580093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:11.580061    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:11.580366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:11.580344    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:11.581053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:11.581035    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:41:12.025642 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:12.025608    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:13.597925 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:13.597891    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:15.134132 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:15.134070    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:16.749150 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:16.749121    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:18.212341 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.212309    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:18.532950 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.532823    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"]
Oct 31 07:41:18.538359 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.538326    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.554713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.554682    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"]
Oct 31 07:41:18.562865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.562833    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-b1fda4-openshift-default-dockercfg-9xncc\""
Oct 31 07:41:18.685246 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.685195    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.685459 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.685335    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.685459 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.685412    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff88r\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-kube-api-access-ff88r\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.685602 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.685473    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.685602 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.685503    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.685602 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.685577    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.685756 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.685613    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.685756 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.685636    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5c516fb-b637-43d1-863e-0916ad4f8457-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.685756 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.685737    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787150    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787216    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787239    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff88r\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-kube-api-access-ff88r\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787269    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787296    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787329    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787361    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787388    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5c516fb-b637-43d1-863e-0916ad4f8457-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787465    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787832 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787679    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787832 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787797    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.787989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.787840    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.788266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.788246    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.788324 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.788302    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5c516fb-b637-43d1-863e-0916ad4f8457-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.790055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.790034    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.790141 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.790039    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.806934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.806894    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.806934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.806928    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff88r\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-kube-api-access-ff88r\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:18.852376 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:18.852341    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:19.169042 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:19.168852    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"]
Oct 31 07:41:19.171989 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:41:19.171957    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c516fb_b637_43d1_863e_0916ad4f8457.slice/crio-d1fcd6bbac8e3e689177002dbd80e722a36638988cab389f68cdb4d0b79dbd00 WatchSource:0}: Error finding container d1fcd6bbac8e3e689177002dbd80e722a36638988cab389f68cdb4d0b79dbd00: Status 404 returned error can't find the container with id d1fcd6bbac8e3e689177002dbd80e722a36638988cab389f68cdb4d0b79dbd00
Oct 31 07:41:19.174549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:19.174517    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:41:19.174629 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:19.174580    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:41:19.174629 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:19.174607    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:41:19.587478 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:19.587437    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" event={"ID":"c5c516fb-b637-43d1-863e-0916ad4f8457","Type":"ContainerStarted","Data":"194ec64d4fcd2b522d3a9959990b03e28be0e16393793215fb667bc34cc8f3b6"}
Oct 31 07:41:19.588035 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:19.587537    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" event={"ID":"c5c516fb-b637-43d1-863e-0916ad4f8457","Type":"ContainerStarted","Data":"d1fcd6bbac8e3e689177002dbd80e722a36638988cab389f68cdb4d0b79dbd00"}
Oct 31 07:41:19.650687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:19.650633    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" podStartSLOduration=1.65061627 podStartE2EDuration="1.65061627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:41:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:41:19.638859603 +0000 UTC m=+794.168054276" watchObservedRunningTime="2026-10-31 07:41:19.65061627 +0000 UTC m=+794.179811157"
Oct 31 07:41:19.722847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:19.722807    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:19.859164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:19.859053    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:20.876110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:20.876057    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 07:41:20.876659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:20.876136    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 07:41:21.205576 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:21.203902    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:21.862412 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:21.862370    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 07:41:21.862689 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:21.862649    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 07:41:22.803121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:22.803089    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:22.861939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:22.858342    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 07:41:22.861939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:22.858413    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 07:41:23.855409 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:23.855366    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 07:41:23.856109 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:23.856075    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 07:41:24.301082 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:24.301052    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:24.855940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:24.855887    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Oct 31 07:41:24.856467 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:24.855968    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Oct 31 07:41:25.814795 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:25.814754    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:26.000534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:26.000492    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:26.011603 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:26.011570    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:26.012405 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:26.012381    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:26.013138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:26.013114    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:41:27.488896 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:27.488861    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:28.696179 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:41:28.696144    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:41:29.245003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:29.244968    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:31.333881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:31.333846    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:33.007242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:33.007211    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:34.402631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:34.402594    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:35.918195 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:35.918161    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:37.405366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:37.405328    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:38.904749 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:38.904712    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:40.402138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:40.402109    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:41.250682 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.250646    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"]
Oct 31 07:41:41.260649 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.260614    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.274340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.274037    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"]
Oct 31 07:41:41.280819 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.280772    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-b1fda4\"/\"default-dockercfg-dzpd4\""
Oct 31 07:41:41.281111 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.281080    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-b1fda4\"/\"openshift-service-ca.crt\""
Oct 31 07:41:41.286858 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.286830    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w5-b1fda4\"/\"kube-root-ca.crt\""
Oct 31 07:41:41.286858 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.286853    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-b1fda4\"/\"distinct-w5-b1fda4-kserve-self-signed-certs\""
Oct 31 07:41:41.287055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.287032    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:41.373554 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.373512    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-dshm\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.373554 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.373555    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-home\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.373810 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.373638    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85vl6\" (UniqueName: \"kubernetes.io/projected/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-kube-api-access-85vl6\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.373810 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.373760    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tls-certs\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.373810 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.373790    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-model-cache\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.374054 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.373812    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tmp-dir\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.474606 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.474568    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tls-certs\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.475170 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.474624    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-model-cache\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.475170 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.474658    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tmp-dir\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.475170 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.474736    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-dshm\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.475170 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.474766    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-home\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.475170 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.474869    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85vl6\" (UniqueName: \"kubernetes.io/projected/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-kube-api-access-85vl6\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.475907 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.475859    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-model-cache\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.476360 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.476331    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-home\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.476731 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.476708    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tmp-dir\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.478406 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.478379    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tls-certs\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.478855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.478831    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-dshm\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.495407 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.495373    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85vl6\" (UniqueName: \"kubernetes.io/projected/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-kube-api-access-85vl6\") pod \"distinct-w5-b1fda4-kserve-7f64797d58-xpq4r\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.580986 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.580862    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:41.670295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.670259    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"]
Oct 31 07:41:41.675471 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.675444    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.696874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.696838    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"]
Oct 31 07:41:41.778448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.778410    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.778603 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.778482    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.778603 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.778529    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkhc7\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-kube-api-access-pkhc7\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.778603 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.778600    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.778729 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.778645    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.778729 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.778721    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.778796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.778750    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.778796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.778782    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.778860 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.778801    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.880093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.879983    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.880093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.880067    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.880555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.880118    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.880555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.880173    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.880555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.880252    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.880555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.880332    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.880555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.880357    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkhc7\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-kube-api-access-pkhc7\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.880555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.880391    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.880555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.880481    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.881425 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.880772    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.881425 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.881274    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-certs\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.881425 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.881314    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-credential-socket\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.881650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.881619    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-data\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.881789 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.881756    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.882658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.882556    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"]
Oct 31 07:41:41.883581 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.883557    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-envoy\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.883733 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.883717    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.885864 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:41:41.885841    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa0cd95f_2f11_4bab_b95e_60c0b22adbc1.slice/crio-d2950cc467d027f32850e9548fcd4473621cd2c560786976bd43538cf0bd1776 WatchSource:0}: Error finding container d2950cc467d027f32850e9548fcd4473621cd2c560786976bd43538cf0bd1776: Status 404 returned error can't find the container with id d2950cc467d027f32850e9548fcd4473621cd2c560786976bd43538cf0bd1776
Oct 31 07:41:41.899384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.899358    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkhc7\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-kube-api-access-pkhc7\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.899384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.899373    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-token\") pod \"maas-default-gateway-openshift-default-645cf464d7-rlbjc\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:41.994116 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:41.994077    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:42.092173 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.090885    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:42.318078 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.318040    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"]
Oct 31 07:41:42.322190 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:41:42.322159    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc23943ef_97b5_4c73_ac3e_3c664fe88ad5.slice/crio-14ab35b1750e920314f489c9eb7ece5f60487c8b36cd326e04089b959fb471f4 WatchSource:0}: Error finding container 14ab35b1750e920314f489c9eb7ece5f60487c8b36cd326e04089b959fb471f4: Status 404 returned error can't find the container with id 14ab35b1750e920314f489c9eb7ece5f60487c8b36cd326e04089b959fb471f4
Oct 31 07:41:42.324838 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.324805    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:41:42.324976 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.324875    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:41:42.324976 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.324904    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:41:42.738566 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.738523    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" event={"ID":"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1","Type":"ContainerStarted","Data":"de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc"}
Oct 31 07:41:42.738566 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.738591    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" event={"ID":"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1","Type":"ContainerStarted","Data":"d2950cc467d027f32850e9548fcd4473621cd2c560786976bd43538cf0bd1776"}
Oct 31 07:41:42.740963 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.740901    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" event={"ID":"c23943ef-97b5-4c73-ac3e-3c664fe88ad5","Type":"ContainerStarted","Data":"151d664300c6f9aced367489eae14eb5914c6a89dfa64e666135c4e5997bc227"}
Oct 31 07:41:42.741159 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.740990    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" event={"ID":"c23943ef-97b5-4c73-ac3e-3c664fe88ad5","Type":"ContainerStarted","Data":"14ab35b1750e920314f489c9eb7ece5f60487c8b36cd326e04089b959fb471f4"}
Oct 31 07:41:42.775642 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.775557    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podStartSLOduration=1.7755381350000001 podStartE2EDuration="1.775538135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:41:42.775158576 +0000 UTC m=+817.304353253" watchObservedRunningTime="2026-10-31 07:41:42.775538135 +0000 UTC m=+817.304732810"
Oct 31 07:41:42.819226 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.819145    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podStartSLOduration=1.8191242989999998 podStartE2EDuration="1.819124299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:41:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:41:42.814013953 +0000 UTC m=+817.343208629" watchObservedRunningTime="2026-10-31 07:41:42.819124299 +0000 UTC m=+817.348318975"
Oct 31 07:41:42.994509 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:42.994384    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:43.584067 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:43.584028    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:43.997983 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:43.997402    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rlbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 07:41:43.997983 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:43.997468    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 07:41:44.036753 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:44.036722    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:44.994950 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:44.994879    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rlbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 07:41:44.995135 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:44.994971    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 07:41:45.994825 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:45.994788    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rlbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 07:41:45.995273 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:45.994852    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 07:41:46.180428 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:46.180390    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:46.994852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:46.994815    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rlbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 07:41:46.995255 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:46.994884    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 07:41:47.847478 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:47.847447    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:47.994958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:47.994909    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rlbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 07:41:47.995332 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:47.994992    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 07:41:48.995339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:48.995292    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rlbjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Oct 31 07:41:48.995778 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:48.995382    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Oct 31 07:41:49.503958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:49.503911    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:50.876886 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:50.876833    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:50.877525 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:50.877500    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:50.878556 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:50.878529    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 07:41:51.226472 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:51.226431    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:51.581984 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:51.581880    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:51.594535 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:51.594509    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:51.835326 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:51.835225    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:41:52.833553 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:52.833517    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:54.406811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:54.406777    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:55.905991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:55.905909    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:57.522063 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:57.522027    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:58.761391 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:41:58.761317    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:41:59.612344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:59.612288    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:41:59.939040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:41:59.938947    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:01.390006 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:01.389945    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:02.311334 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.311295    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"]
Oct 31 07:42:02.316049 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.316021    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.332745 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.332711    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"]
Oct 31 07:42:02.341162 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.341135    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-3dff3f\"/\"distinct-w4-3dff3f-kserve-self-signed-certs\""
Oct 31 07:42:02.346726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.346678    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:02.376287 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.376252    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tls-certs\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.376481 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.376308    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tzz9\" (UniqueName: \"kubernetes.io/projected/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-kube-api-access-9tzz9\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.376481 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.376407    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-dshm\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.376481 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.376454    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tmp-dir\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.376636 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.376611    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-home\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.376749 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.376731    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-model-cache\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.477821 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.477777    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tzz9\" (UniqueName: \"kubernetes.io/projected/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-kube-api-access-9tzz9\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.478523 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.478491    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-dshm\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.478653 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.478548    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tmp-dir\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.478653 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.478641    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-home\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.478786 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.478766    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-model-cache\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.479053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.479031    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tls-certs\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.479265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.479239    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tmp-dir\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.479401 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.479282    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-home\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.479543 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.479521    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-model-cache\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.482214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.482187    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-dshm\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.482599 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.482577    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tls-certs\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.511483 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.511065    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tzz9\" (UniqueName: \"kubernetes.io/projected/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-kube-api-access-9tzz9\") pod \"distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") " pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.632306 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.632219    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:02.932790 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.932756    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"]
Oct 31 07:42:02.937137 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:42:02.937103    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9788c2a9_b8cf_48ec_8c2d_128b0e9289fc.slice/crio-bb87f3917736421d62fe27d668a79be0c601573364e28a4497a8a983133d78ac WatchSource:0}: Error finding container bb87f3917736421d62fe27d668a79be0c601573364e28a4497a8a983133d78ac: Status 404 returned error can't find the container with id bb87f3917736421d62fe27d668a79be0c601573364e28a4497a8a983133d78ac
Oct 31 07:42:02.964140 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:02.964112    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:03.935002 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:03.934964    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" event={"ID":"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc","Type":"ContainerStarted","Data":"e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc"}
Oct 31 07:42:03.935002 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:03.935013    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" event={"ID":"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc","Type":"ContainerStarted","Data":"bb87f3917736421d62fe27d668a79be0c601573364e28a4497a8a983133d78ac"}
Oct 31 07:42:03.971820 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:03.971765    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podStartSLOduration=1.971744106 podStartE2EDuration="1.971744106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:03.971673284 +0000 UTC m=+838.500867959" watchObservedRunningTime="2026-10-31 07:42:03.971744106 +0000 UTC m=+838.500938779"
Oct 31 07:42:04.497596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:04.497533    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:04.632336 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:04.632291    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:06.131061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:06.131024    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:06.556031 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:06.555969    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:07.717952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:07.717898    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:09.327926 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:09.327874    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:11.005006 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:10.985613    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:11.192675 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:11.192576    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:11.374161 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:11.374029    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:12.633121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:12.633077    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:12.645990 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:12.645956    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:12.945609 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:12.945500    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:13.053527 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:13.053491    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:42:14.418284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:14.418244    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:15.925307 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:15.925193    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:17.528287 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:17.528248    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:18.685569 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.685532    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"]
Oct 31 07:42:18.691379 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.691358    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.721376 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.721345    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"]
Oct 31 07:42:18.790482 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.790446    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.790656 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.790490    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.790656 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.790620    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.790741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.790655    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.790786 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.790737    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbnbh\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-kube-api-access-qbnbh\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.790822 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.790794    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748b63d2-2388-42ce-b73f-ecd48db35002-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.790865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.790819    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.790904 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.790874    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748b63d2-2388-42ce-b73f-ecd48db35002-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.790966 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.790933    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.795559 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.795525    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"]
Oct 31 07:42:18.800870 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.800837    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.820479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.820443    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-648fbe-openshift-default-dockercfg-2vh69\""
Oct 31 07:42:18.820802 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.820775    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"]
Oct 31 07:42:18.892064 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892021    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.892064 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892063    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.892290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892130    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgnq4\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-kube-api-access-bgnq4\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.892290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892164    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.892290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892183    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.892290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892235    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.892444 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892297    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbnbh\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-kube-api-access-qbnbh\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.892444 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892318    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.892444 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892353    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748b63d2-2388-42ce-b73f-ecd48db35002-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.892444 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892369    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.892647 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892521    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.892647 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892543    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.892647 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892590    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748b63d2-2388-42ce-b73f-ecd48db35002-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.892647 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892619    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.892875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892690    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.892875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892740    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.892875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892799    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.892875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892831    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.893093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.892969    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.893093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.893040    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.893282 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.893256    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.893374 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.893294    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.893374 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.893357    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748b63d2-2388-42ce-b73f-ecd48db35002-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.894706 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.894681    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.895165 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.895146    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748b63d2-2388-42ce-b73f-ecd48db35002-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.910008 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.909985    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbnbh\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-kube-api-access-qbnbh\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.910101 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.910048    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:18.994252 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994217    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgnq4\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-kube-api-access-bgnq4\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.994437 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994273    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.994437 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994312    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.994437 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994342    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.994437 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994370    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.994437 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994408    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.994725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994451    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.994725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994542    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.994725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994566    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.994900 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994856    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.995002 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.994907    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.995093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.995071    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.995153 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.995109    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.995441 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.995416    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.996819 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.996795    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:18.997051 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:18.997030    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:19.005290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.005261    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:19.011818 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.011794    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgnq4\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-kube-api-access-bgnq4\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:19.012855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.012832    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:19.064198 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.064074    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:19.117638 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.117608    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:19.322552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.322367    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"]
Oct 31 07:42:19.325618 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:42:19.325589    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748b63d2_2388_42ce_b73f_ecd48db35002.slice/crio-6b75484f645dca2a6c326a238981696b30d9a8b4a17fa516d5ce6bc345bbd608 WatchSource:0}: Error finding container 6b75484f645dca2a6c326a238981696b30d9a8b4a17fa516d5ce6bc345bbd608: Status 404 returned error can't find the container with id 6b75484f645dca2a6c326a238981696b30d9a8b4a17fa516d5ce6bc345bbd608
Oct 31 07:42:19.328032 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.327997    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:19.328115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.328095    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:19.328157 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.328126    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:19.437385 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.437353    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"]
Oct 31 07:42:19.441421 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:42:19.441385    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a0edf1c_3207_446b_9dfa_ffd9525690bd.slice/crio-7e9e0839bcb92919c6354034b1c313d957dc5c99f517295c34eb048986af7fcd WatchSource:0}: Error finding container 7e9e0839bcb92919c6354034b1c313d957dc5c99f517295c34eb048986af7fcd: Status 404 returned error can't find the container with id 7e9e0839bcb92919c6354034b1c313d957dc5c99f517295c34eb048986af7fcd
Oct 31 07:42:19.444305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.444270    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:19.444389 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.444346    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:19.444389 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:19.444376    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:20.107150 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.107112    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" event={"ID":"748b63d2-2388-42ce-b73f-ecd48db35002","Type":"ContainerStarted","Data":"c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c"}
Oct 31 07:42:20.107582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.107179    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" event={"ID":"748b63d2-2388-42ce-b73f-ecd48db35002","Type":"ContainerStarted","Data":"6b75484f645dca2a6c326a238981696b30d9a8b4a17fa516d5ce6bc345bbd608"}
Oct 31 07:42:20.109052 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.109021    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" event={"ID":"8a0edf1c-3207-446b-9dfa-ffd9525690bd","Type":"ContainerStarted","Data":"c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3"}
Oct 31 07:42:20.109206 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.109180    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" event={"ID":"8a0edf1c-3207-446b-9dfa-ffd9525690bd","Type":"ContainerStarted","Data":"7e9e0839bcb92919c6354034b1c313d957dc5c99f517295c34eb048986af7fcd"}
Oct 31 07:42:20.117998 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.117974    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:20.119416 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.119390    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 31 07:42:20.119510 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.119461    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 31 07:42:20.188939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.178127    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" podStartSLOduration=2.178108303 podStartE2EDuration="2.178108303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:20.176605735 +0000 UTC m=+854.705800411" watchObservedRunningTime="2026-10-31 07:42:20.178108303 +0000 UTC m=+854.707302979"
Oct 31 07:42:20.225720 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.221680    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" podStartSLOduration=2.221660838 podStartE2EDuration="2.221660838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:20.218521398 +0000 UTC m=+854.747716073" watchObservedRunningTime="2026-10-31 07:42:20.221660838 +0000 UTC m=+854.750855513"
Oct 31 07:42:20.737331 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:20.737296    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:21.005635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:21.005536    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:21.007356 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:21.007333    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 07:42:21.007429 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:21.007380    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 07:42:21.118343 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:21.118300    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 31 07:42:21.118837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:21.118356    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 31 07:42:22.006487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:22.006436    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 07:42:22.006690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:22.006507    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 07:42:22.118431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:22.118392    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 31 07:42:22.118854 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:22.118445    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 31 07:42:22.447439 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:22.447340    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:23.009943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:23.006628    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 07:42:23.009943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:23.006704    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 07:42:23.118305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:23.118267    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 31 07:42:23.118502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:23.118322    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 31 07:42:24.006385 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:24.006338    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 07:42:24.006580 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:24.006408    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 07:42:24.117655 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:24.117619    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:24.117940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:24.117902    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 31 07:42:24.118002 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:24.117966    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 31 07:42:25.006061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:25.006024    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 07:42:25.006483 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:25.006083    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 07:42:25.119110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:25.119075    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 31 07:42:25.119367 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:25.119338    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 31 07:42:25.734588 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:25.734472    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:26.006115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.006013    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Oct 31 07:42:26.006115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.006086    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Oct 31 07:42:26.121423 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.121382    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Oct 31 07:42:26.121589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.121457    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Oct 31 07:42:26.213648 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.213605    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"]
Oct 31 07:42:26.218182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.218147    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.269899 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.266206    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w5-b1fda4\"/\"distinct-2-w5-b1fda4-kserve-self-signed-certs\""
Oct 31 07:42:26.284601 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.284564    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:26.288863 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.288830    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"]
Oct 31 07:42:26.352690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.352638    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-dshm\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.352891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.352700    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45rnp\" (UniqueName: \"kubernetes.io/projected/cf9f27cd-2223-42d0-9150-54a9a4e032cb-kube-api-access-45rnp\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.352891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.352744    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tmp-dir\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.352891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.352773    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-home\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.353233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.353022    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-model-cache\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.353233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.353050    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tls-certs\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.459939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.459614    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-dshm\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.459939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.459671    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45rnp\" (UniqueName: \"kubernetes.io/projected/cf9f27cd-2223-42d0-9150-54a9a4e032cb-kube-api-access-45rnp\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.459939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.459718    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tmp-dir\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.459939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.459748    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-home\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.460293 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.459992    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-model-cache\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.460293 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.460017    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tls-certs\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.460970 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.460943    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tmp-dir\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.461371 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.461342    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-home\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.461678 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.461658    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-model-cache\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.475936 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.471418    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-dshm\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.491939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.484397    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45rnp\" (UniqueName: \"kubernetes.io/projected/cf9f27cd-2223-42d0-9150-54a9a4e032cb-kube-api-access-45rnp\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.501092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.497567    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tls-certs\") pod \"distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") " pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.574872 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.572887    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:26.912635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:26.912552    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"]
Oct 31 07:42:26.916942 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:42:26.916895    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf9f27cd_2223_42d0_9150_54a9a4e032cb.slice/crio-049e63a5f7fb68e1da28aad277dddd41e7eb4df53de2ad5572f59d5a6d012676 WatchSource:0}: Error finding container 049e63a5f7fb68e1da28aad277dddd41e7eb4df53de2ad5572f59d5a6d012676: Status 404 returned error can't find the container with id 049e63a5f7fb68e1da28aad277dddd41e7eb4df53de2ad5572f59d5a6d012676
Oct 31 07:42:27.010773 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.010741    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:27.011259 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.011172    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:27.012108 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.012080    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:42:27.124376 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.123804    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:27.124994 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.124957    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:27.125691 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.125662    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:42:27.160669 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.160631    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" event={"ID":"cf9f27cd-2223-42d0-9150-54a9a4e032cb","Type":"ContainerStarted","Data":"4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4"}
Oct 31 07:42:27.160812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.160679    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" event={"ID":"cf9f27cd-2223-42d0-9150-54a9a4e032cb","Type":"ContainerStarted","Data":"049e63a5f7fb68e1da28aad277dddd41e7eb4df53de2ad5572f59d5a6d012676"}
Oct 31 07:42:27.203558 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.203447    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podStartSLOduration=1.203426415 podStartE2EDuration="1.203426415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:27.199808273 +0000 UTC m=+861.729002966" watchObservedRunningTime="2026-10-31 07:42:27.203426415 +0000 UTC m=+861.732621090"
Oct 31 07:42:27.500617 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.500582    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:27.574038 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:27.573980    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:28.747737 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:42:28.747681    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:42:29.676723 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:29.676682    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:31.209680 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:31.209645    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:32.685173 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:32.685142    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:33.249511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.249476    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"]
Oct 31 07:42:33.254017 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.253997    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.268593 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.268571    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-3cc201-openshift-default-dockercfg-2c2sr\""
Oct 31 07:42:33.292134 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.292103    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"]
Oct 31 07:42:33.347527 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.347493    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"]
Oct 31 07:42:33.351514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.351484    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.351680 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.351654    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aee094c-6b06-4abf-b870-829c88c55137-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.351794 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.351750    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.351888 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.351869    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.352010 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.351955    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.352010 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.351992    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.352096 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.352072    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtfc9\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-kube-api-access-jtfc9\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.352096 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.352094    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aee094c-6b06-4abf-b870-829c88c55137-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.352234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.352117    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.352234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.352190    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.370528 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.370505    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-027d2a-openshift-default-dockercfg-7m2tr\""
Oct 31 07:42:33.375974 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.375947    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"]
Oct 31 07:42:33.453443 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.453391    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.453641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.453538    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.453641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.453576    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm8hc\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-kube-api-access-qm8hc\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.453641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.453609    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.453826 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.453722    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.453826 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.453768    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.453954 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.453870    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtfc9\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-kube-api-access-jtfc9\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.453954 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.453910    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aee094c-6b06-4abf-b870-829c88c55137-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.454071 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.453973    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.454071 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454024    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.454071 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454065    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.454222 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454093    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.454222 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454100    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.454222 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454125    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.454389 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454239    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aee094c-6b06-4abf-b870-829c88c55137-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.454389 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454282    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.454497 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454380    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.454497 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454421    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.454497 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454460    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.454669 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454510    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.454669 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454572    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.454778 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.454748    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.455348 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.455323    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aee094c-6b06-4abf-b870-829c88c55137-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.457564 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.457538    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.457713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.457691    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aee094c-6b06-4abf-b870-829c88c55137-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.473681 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.473650    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.474017 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.473994    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtfc9\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-kube-api-access-jtfc9\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.556119 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556021    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm8hc\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-kube-api-access-qm8hc\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556119 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556080    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556119 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556112    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556194    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556221    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556293    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556332    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556375    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556412    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556483    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556565    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556649    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.556903 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.556788    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.557274 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.557247    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.559338 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.559307    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.559458 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.559440    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.568508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.568488    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:33.574558 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.574531    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.574670 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.574598    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm8hc\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-kube-api-access-qm8hc\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.666889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.666851    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:33.895356 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.895248    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"]
Oct 31 07:42:33.898701 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:42:33.898665    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aee094c_6b06_4abf_b870_829c88c55137.slice/crio-e119011cf9b2c150991a49736940fc0507c4c542b3ba50c607e65e824d7f26b0 WatchSource:0}: Error finding container e119011cf9b2c150991a49736940fc0507c4c542b3ba50c607e65e824d7f26b0: Status 404 returned error can't find the container with id e119011cf9b2c150991a49736940fc0507c4c542b3ba50c607e65e824d7f26b0
Oct 31 07:42:33.901887 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.901849    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:33.902016 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.901956    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:33.902016 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.902000    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:33.984191 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.984152    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"]
Oct 31 07:42:33.989249 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:42:33.989211    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fbb78a6_fb23_4504_9171_f3f9b9a2a2df.slice/crio-a5496b5c9fef6d606d5caf4a843079bab80d9c89570f117f2ae4fb8d5bf13646 WatchSource:0}: Error finding container a5496b5c9fef6d606d5caf4a843079bab80d9c89570f117f2ae4fb8d5bf13646: Status 404 returned error can't find the container with id a5496b5c9fef6d606d5caf4a843079bab80d9c89570f117f2ae4fb8d5bf13646
Oct 31 07:42:33.993075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.993033    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:33.993194 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.993126    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:33.993194 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:33.993169    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:42:34.230736 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.230383    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" event={"ID":"2aee094c-6b06-4abf-b870-829c88c55137","Type":"ContainerStarted","Data":"36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f"}
Oct 31 07:42:34.230965 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.230775    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" event={"ID":"2aee094c-6b06-4abf-b870-829c88c55137","Type":"ContainerStarted","Data":"e119011cf9b2c150991a49736940fc0507c4c542b3ba50c607e65e824d7f26b0"}
Oct 31 07:42:34.232560 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.232522    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" event={"ID":"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df","Type":"ContainerStarted","Data":"377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5"}
Oct 31 07:42:34.232714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.232579    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" event={"ID":"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df","Type":"ContainerStarted","Data":"a5496b5c9fef6d606d5caf4a843079bab80d9c89570f117f2ae4fb8d5bf13646"}
Oct 31 07:42:34.275597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.275535    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" podStartSLOduration=1.2755151439999999 podStartE2EDuration="1.275515144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:34.271227058 +0000 UTC m=+868.800421732" watchObservedRunningTime="2026-10-31 07:42:34.275515144 +0000 UTC m=+868.804709821"
Oct 31 07:42:34.316331 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.316273    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" podStartSLOduration=1.316260226 podStartE2EDuration="1.316260226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:34.314508102 +0000 UTC m=+868.843702777" watchObservedRunningTime="2026-10-31 07:42:34.316260226 +0000 UTC m=+868.845454900"
Oct 31 07:42:34.363235 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.363176    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:34.560973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.560816    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:34.573032 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.572970    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:34.573396 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.573369    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 31 07:42:34.573625 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.573601    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 31 07:42:34.675494 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:34.675457    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:35.574433 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:35.574392    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 31 07:42:35.575099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:35.575060    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 31 07:42:35.681962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:35.674842    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 07:42:35.683221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:35.674907    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 07:42:36.200938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:36.200501    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:36.570102 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:36.570063    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 31 07:42:36.570412 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:36.570379    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 31 07:42:36.592221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:36.576144    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:36.615952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:36.613559    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:36.674940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:36.674384    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 07:42:36.674940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:36.674470    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 07:42:37.318961 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:37.318896    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:42:37.578004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:37.577440    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 31 07:42:37.578004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:37.577545    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 31 07:42:37.673941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:37.673357    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 07:42:37.673941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:37.673442    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 07:42:38.572942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:38.571334    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 31 07:42:38.572942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:38.571424    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 31 07:42:38.629944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:38.629878    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:38.674943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:38.673473    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 07:42:38.674943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:38.673538    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 07:42:39.578942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:39.571467    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 31 07:42:39.578942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:39.571535    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 31 07:42:39.671942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:39.668394    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 07:42:39.671942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:39.668468    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 07:42:40.569540 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:40.569486    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused" start-of-body=
Oct 31 07:42:40.569992 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:40.569569    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.83:15021/healthz/ready\": dial tcp 10.132.0.83:15021: connect: connection refused"
Oct 31 07:42:40.668386 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:40.668341    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Oct 31 07:42:40.668562 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:40.668427    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Oct 31 07:42:40.678968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:40.678926    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:41.573610 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:41.573541    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:41.574163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:41.574034    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:41.574816 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:41.574793    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:42:41.673459 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:41.673427    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:41.673830 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:41.673809    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:41.674474 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:41.674440    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:42:42.405465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:42.405433    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:43.893461 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:43.893420    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:45.304481 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:45.304441    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:46.872246 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:46.872206    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:49.839874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:49.839832    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:50.148820 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:50.148735    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:51.411874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:51.411837    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:53.013596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:53.013561    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:54.513136 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:54.513105    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:56.110117 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:56.110073    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:57.269217 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.269179    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"]
Oct 31 07:42:57.273629 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.273602    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.294827 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.294795    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"]
Oct 31 07:42:57.300869 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.300843    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-027d2a\"/\"distinct-w6-027d2a-kserve-self-signed-certs\""
Oct 31 07:42:57.320512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.320483    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:57.365767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.365732    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-dshm\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.365991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.365802    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0640587b-51a9-427b-b891-dd0ff80d1d23-tls-certs\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.365991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.365896    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-tmp-dir\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.365991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.365966    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g267r\" (UniqueName: \"kubernetes.io/projected/0640587b-51a9-427b-b891-dd0ff80d1d23-kube-api-access-g267r\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.366162 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.366112    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-home\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.366220 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.366209    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-model-cache\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.471505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.471462    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-model-cache\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.473356 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.473329    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-dshm\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.473611 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.473594    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0640587b-51a9-427b-b891-dd0ff80d1d23-tls-certs\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.473753 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.473736    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-tmp-dir\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.473932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.473869    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g267r\" (UniqueName: \"kubernetes.io/projected/0640587b-51a9-427b-b891-dd0ff80d1d23-kube-api-access-g267r\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.474068 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.473995    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-home\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.474396 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.474374    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-home\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.474492 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.472162    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-model-cache\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.475024 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.474993    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-tmp-dir\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.483968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.483252    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0640587b-51a9-427b-b891-dd0ff80d1d23-tls-certs\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.494789 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.494226    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-dshm\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.547217 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.547111    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g267r\" (UniqueName: \"kubernetes.io/projected/0640587b-51a9-427b-b891-dd0ff80d1d23-kube-api-access-g267r\") pod \"distinct-w6-027d2a-kserve-775f5cd64c-grrrg\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") " pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.590724 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.590684    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:57.811296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.811205    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:42:57.909744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:57.909696    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"]
Oct 31 07:42:57.914626 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:42:57.914586    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0640587b_51a9_427b_b891_dd0ff80d1d23.slice/crio-955306dd5965f13dce0d2ce35b91ec55e2df8bfac117698846f085a8a0ed9601 WatchSource:0}: Error finding container 955306dd5965f13dce0d2ce35b91ec55e2df8bfac117698846f085a8a0ed9601: Status 404 returned error can't find the container with id 955306dd5965f13dce0d2ce35b91ec55e2df8bfac117698846f085a8a0ed9601
Oct 31 07:42:58.568990 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:58.568910    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" event={"ID":"0640587b-51a9-427b-b891-dd0ff80d1d23","Type":"ContainerStarted","Data":"c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74"}
Oct 31 07:42:58.569509 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:58.569484    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" event={"ID":"0640587b-51a9-427b-b891-dd0ff80d1d23","Type":"ContainerStarted","Data":"955306dd5965f13dce0d2ce35b91ec55e2df8bfac117698846f085a8a0ed9601"}
Oct 31 07:42:58.591068 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:58.591020    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:42:58.605551 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:58.605497    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" podStartSLOduration=1.605482076 podStartE2EDuration="1.605482076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:42:58.605152723 +0000 UTC m=+893.134347398" watchObservedRunningTime="2026-10-31 07:42:58.605482076 +0000 UTC m=+893.134676749"
Oct 31 07:42:58.761934 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:42:58.758432    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:42:59.519058 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:42:59.519020    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:01.016071 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:01.016031    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:02.583632 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:02.583593    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:02.801705 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:02.801659    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:03.811537 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.811498    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"]
Oct 31 07:43:03.815843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.815824    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.849456 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.849422    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"]
Oct 31 07:43:03.868357 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.868323    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.868508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.868370    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.868508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.868387    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.868508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.868458    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.868636 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.868530    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.868636 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.868553    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74h9v\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-kube-api-access-74h9v\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.868636 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.868606    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.868763 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.868741    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.868801 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.868774    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970123 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970079    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970137    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970167    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970193    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970261    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970297    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74h9v\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-kube-api-access-74h9v\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970326    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970661 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970495    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970661 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970524    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970781 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970703    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-certs\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.970987 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970945    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istiod-ca-cert\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.971093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.970972    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-credential-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.971093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.971021    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-data\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.971177 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.971107    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-socket\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.972678 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.972655    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-envoy\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.973004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.972985    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-podinfo\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.990502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.990474    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-token\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:03.993713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:03.993683    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74h9v\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-kube-api-access-74h9v\") pod \"e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") " pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:04.125109 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:04.125030    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:04.132440 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:04.132412    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:04.452570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:04.452431    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"]
Oct 31 07:43:04.455626 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:43:04.455596    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d46ac1c_71c4_4f3c_af7e_f4de12cee963.slice/crio-a54249ff5b12085cbc44d82ae2c55ff2c97cfdf8b2bfe61b6050fc90c0655b3b WatchSource:0}: Error finding container a54249ff5b12085cbc44d82ae2c55ff2c97cfdf8b2bfe61b6050fc90c0655b3b: Status 404 returned error can't find the container with id a54249ff5b12085cbc44d82ae2c55ff2c97cfdf8b2bfe61b6050fc90c0655b3b
Oct 31 07:43:04.458508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:04.458476    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:04.458579 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:04.458544    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:04.458579 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:04.458574    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:04.620274 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:04.620234    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" event={"ID":"0d46ac1c-71c4-4f3c-af7e-f4de12cee963","Type":"ContainerStarted","Data":"82436e6e5ad508c1ac90b2e26450f959054891527a8af17adfe06f88e551524f"}
Oct 31 07:43:04.620531 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:04.620297    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" event={"ID":"0d46ac1c-71c4-4f3c-af7e-f4de12cee963","Type":"ContainerStarted","Data":"a54249ff5b12085cbc44d82ae2c55ff2c97cfdf8b2bfe61b6050fc90c0655b3b"}
Oct 31 07:43:04.664591 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:04.664504    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" podStartSLOduration=1.664153256 podStartE2EDuration="1.664153256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:04.660844236 +0000 UTC m=+899.190038910" watchObservedRunningTime="2026-10-31 07:43:04.664153256 +0000 UTC m=+899.193347931"
Oct 31 07:43:05.133092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:05.133056    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:05.135001 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:05.134975    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 07:43:05.135113 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:05.135038    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 07:43:05.771939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:05.765103    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:43:05.771939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:05.767173    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:43:05.790218 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:05.790183    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:43:05.791075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:05.791047    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:43:06.039554 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:06.039450    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:06.133373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:06.133335    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 07:43:06.133779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:06.133395    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 07:43:06.699593 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:06.699553    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:07.133114 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.133077    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 07:43:07.133334 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.133142    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 07:43:07.591469 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.591429    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:43:07.606592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.606558    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:43:07.677944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.677010    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:43:07.730804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.730758    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"]
Oct 31 07:43:07.737379 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.737346    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.783169 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.783131    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-4794f5\"/\"distinct-w1-4794f5-kserve-self-signed-certs\""
Oct 31 07:43:07.785732 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.785707    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"]
Oct 31 07:43:07.787268 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.787247    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:07.818448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.818270    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tmp-dir\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.818894 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.818868    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-model-cache\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.819084 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.819055    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgm6b\" (UniqueName: \"kubernetes.io/projected/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-kube-api-access-qgm6b\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.819331 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.819302    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tls-certs\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.819589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.819574    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-dshm\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.819718 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.819704    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-home\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.921167 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.921075    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-model-cache\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.921361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.921344    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgm6b\" (UniqueName: \"kubernetes.io/projected/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-kube-api-access-qgm6b\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.921499 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.921479    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-model-cache\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.921551 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.921492    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tls-certs\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.921684 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.921674    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-dshm\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.921752 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.921744    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-home\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.921846 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.921838    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tmp-dir\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.922280 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.922256    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tmp-dir\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.922443 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.922317    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-home\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.924326 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.924300    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tls-certs\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.924423 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.924372    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-dshm\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:07.964937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:07.959999    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgm6b\" (UniqueName: \"kubernetes.io/projected/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-kube-api-access-qgm6b\") pod \"distinct-w1-4794f5-kserve-6cd48ffbcc-lx996\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") " pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:08.087172 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:08.087124    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:08.133991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:08.133665    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 07:43:08.133991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:08.133726    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 07:43:08.192765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:08.188701    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:08.477597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:08.476848    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"]
Oct 31 07:43:08.482575 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:43:08.482547    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23046dd8_ddf6_4eac_a359_db2a4ef5fae6.slice/crio-7cff7a6ef1ff255a5dfe12535ea6a798e9df59ec97d041c5720489251d15843a WatchSource:0}: Error finding container 7cff7a6ef1ff255a5dfe12535ea6a798e9df59ec97d041c5720489251d15843a: Status 404 returned error can't find the container with id 7cff7a6ef1ff255a5dfe12535ea6a798e9df59ec97d041c5720489251d15843a
Oct 31 07:43:08.650619 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:08.650580    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" event={"ID":"23046dd8-ddf6-4eac-a359-db2a4ef5fae6","Type":"ContainerStarted","Data":"be14d711a92d36866c693a446c1a0460966db45a7df2649d14aee3a8be039d65"}
Oct 31 07:43:08.651113 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:08.650634    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" event={"ID":"23046dd8-ddf6-4eac-a359-db2a4ef5fae6","Type":"ContainerStarted","Data":"7cff7a6ef1ff255a5dfe12535ea6a798e9df59ec97d041c5720489251d15843a"}
Oct 31 07:43:08.691134 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:08.691077    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podStartSLOduration=1.691063438 podStartE2EDuration="1.691063438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:08.690074755 +0000 UTC m=+903.219269429" watchObservedRunningTime="2026-10-31 07:43:08.691063438 +0000 UTC m=+903.220258111"
Oct 31 07:43:09.088021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:09.087987    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:09.133785 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:09.133746    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 07:43:09.133990 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:09.133807    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 07:43:10.133592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:10.133549    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 07:43:10.134042 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:10.133627    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 07:43:10.346975 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:10.346939    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:11.133169 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:11.133131    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Oct 31 07:43:11.133356 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:11.133193    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Oct 31 07:43:11.366266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:11.366225    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:12.040290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:12.040253    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:12.139147 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:12.139110    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:12.139560 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:12.139530    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:12.140690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:12.140667    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:43:13.657968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:13.657926    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:15.221210 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:15.221175    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:16.825301 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:16.825267    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:18.087890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.087846    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:18.102291 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.102264    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:18.348744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.348645    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:18.748134 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.748098    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"]
Oct 31 07:43:18.753365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.753332    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.796766 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.796717    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"]
Oct 31 07:43:18.869530 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.869243    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:43:18.892709 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.892658    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.893057 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.893029    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.893240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.893221    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.893350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.893335    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.893500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.893486    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc664199-a36b-4404-9308-ef77ec4b2656-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.893680 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.893666    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc664199-a36b-4404-9308-ef77ec4b2656-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.893853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.893837    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx8lb\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-kube-api-access-bx8lb\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.897022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.896993    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.897298 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.897279    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.968467 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.968433    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"]
Oct 31 07:43:18.973112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.973082    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:18.995043 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.994426    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"]
Oct 31 07:43:18.999014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.998410    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.999014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.998453    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.999014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.998518    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc664199-a36b-4404-9308-ef77ec4b2656-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.999014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.998599    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc664199-a36b-4404-9308-ef77ec4b2656-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.999014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.998683    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx8lb\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-kube-api-access-bx8lb\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.999014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.998725    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.999014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.998836    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.999014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.998889    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:18.999014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:18.998943    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.000132 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.000100    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.005021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.001004    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc664199-a36b-4404-9308-ef77ec4b2656-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.005021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.001111    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.005021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.001333    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.005021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.001604    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.005021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.003900    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.005021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.004483    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc664199-a36b-4404-9308-ef77ec4b2656-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.036939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.028046    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.046959 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.046853    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx8lb\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-kube-api-access-bx8lb\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.098138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.098088    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:19.099822 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.099790    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.100019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.099975    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35afb827-a07f-46ee-9994-d893a25527ca-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.100088 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.100021    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35afb827-a07f-46ee-9994-d893a25527ca-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.100147 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.100120    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.100197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.100152    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.100281 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.100254    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.100344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.100327    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zvvn\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-kube-api-access-5zvvn\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.100512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.100485    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.100583 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.100544    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.207344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.206318    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.207344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.206368    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.207344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.206412    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.207344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.206498    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35afb827-a07f-46ee-9994-d893a25527ca-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.207344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.206532    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35afb827-a07f-46ee-9994-d893a25527ca-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.207344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.206580    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.207344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.206610    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.207344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.206651    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.207344 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.206695    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zvvn\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-kube-api-access-5zvvn\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.208367 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.208335    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.208897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.208867    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35afb827-a07f-46ee-9994-d893a25527ca-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.209072 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.209047    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.209208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.209188    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.209352 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.209317    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.211608 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.211561    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35afb827-a07f-46ee-9994-d893a25527ca-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.213743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.213702    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.226943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.225625    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zvvn\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-kube-api-access-5zvvn\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.226943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.226571    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.296540 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.296444    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:19.449883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.448995    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"]
Oct 31 07:43:19.468306 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:43:19.468238    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc664199_a36b_4404_9308_ef77ec4b2656.slice/crio-3ae3896ea99af4639fe61805e38d5414fcec6987734ff0793e82a62e156df3cf WatchSource:0}: Error finding container 3ae3896ea99af4639fe61805e38d5414fcec6987734ff0793e82a62e156df3cf: Status 404 returned error can't find the container with id 3ae3896ea99af4639fe61805e38d5414fcec6987734ff0793e82a62e156df3cf
Oct 31 07:43:19.572442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.570741    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:19.572442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.570835    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:19.572442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.570878    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:19.681972 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.681942    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"]
Oct 31 07:43:19.687655 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:43:19.687630    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35afb827_a07f_46ee_9994_d893a25527ca.slice/crio-c7b49602f45693490f629113255f2bc46c513ab58972f6b0392d7990eb667154 WatchSource:0}: Error finding container c7b49602f45693490f629113255f2bc46c513ab58972f6b0392d7990eb667154: Status 404 returned error can't find the container with id c7b49602f45693490f629113255f2bc46c513ab58972f6b0392d7990eb667154
Oct 31 07:43:19.695514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.694960    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:19.695514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.695052    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:19.695514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.695094    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:19.802940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.799506    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" event={"ID":"35afb827-a07f-46ee-9994-d893a25527ca","Type":"ContainerStarted","Data":"c7b49602f45693490f629113255f2bc46c513ab58972f6b0392d7990eb667154"}
Oct 31 07:43:19.807934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.803886    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" event={"ID":"bc664199-a36b-4404-9308-ef77ec4b2656","Type":"ContainerStarted","Data":"32b830d82a1d78179bc2d8c17aca5c334d83d9d40e8dd28665e285c007c1bdaa"}
Oct 31 07:43:19.807934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.803972    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" event={"ID":"bc664199-a36b-4404-9308-ef77ec4b2656","Type":"ContainerStarted","Data":"3ae3896ea99af4639fe61805e38d5414fcec6987734ff0793e82a62e156df3cf"}
Oct 31 07:43:19.864090 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:19.863999    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" podStartSLOduration=1.85673027 podStartE2EDuration="1.85673027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:19.849094382 +0000 UTC m=+914.378289048" watchObservedRunningTime="2026-10-31 07:43:19.85673027 +0000 UTC m=+914.385924947"
Oct 31 07:43:20.099449 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:20.099297    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:20.100118 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:20.100002    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 07:43:20.100118 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:20.100077    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 07:43:20.854407 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:20.854364    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" event={"ID":"35afb827-a07f-46ee-9994-d893a25527ca","Type":"ContainerStarted","Data":"5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626"}
Oct 31 07:43:21.102820 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:21.102785    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:21.103955 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:21.103927    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 07:43:21.104174 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:21.104150    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 07:43:21.301657 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:21.301625    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:21.302037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:21.302015    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 07:43:21.302231 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:21.302206    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 07:43:22.100211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:22.100172    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 07:43:22.100503 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:22.100457    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 07:43:22.297950 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:22.297420    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 07:43:22.297950 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:22.297499    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 07:43:23.100942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:23.100488    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 07:43:23.100942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:23.100550    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 07:43:23.299942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:23.299308    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 07:43:23.299942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:23.299390    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 07:43:23.407996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:23.405407    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:24.102635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:24.102583    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 07:43:24.102861 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:24.102655    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 07:43:24.305280 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:24.304605    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 07:43:24.305280 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:24.304687    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 07:43:25.100378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:25.100335    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 07:43:25.100675 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:25.100629    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 07:43:25.300085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:25.300040    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 07:43:25.300348 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:25.300318    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 07:43:25.422876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:25.422789    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:26.099125 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:26.099081    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused" start-of-body=
Oct 31 07:43:26.099318 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:26.099139    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.88:15021/healthz/ready\": dial tcp 10.132.0.88:15021: connect: connection refused"
Oct 31 07:43:26.296889 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:26.296852    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 07:43:26.297067 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:26.296935    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 07:43:26.501460 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:26.501420    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:27.297456 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:27.297416    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Oct 31 07:43:27.297625 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:27.297501    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Oct 31 07:43:27.516531 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:27.516491    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:27.517523 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:27.517480    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:27.520549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:27.520519    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:43:27.555853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:27.555717    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" podStartSLOduration=9.555695493 podStartE2EDuration="9.555695493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:20.944957025 +0000 UTC m=+915.474151700" watchObservedRunningTime="2026-10-31 07:43:27.555695493 +0000 UTC m=+922.084890173"
Oct 31 07:43:27.699773 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:27.699719    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:28.301272 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:28.301240    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:28.301563 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:28.301538    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:28.302229 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:28.302210    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:43:28.697458 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:43:28.697366    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:43:28.876535 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:28.876498    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:29.304389 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:29.304356    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:30.735028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:30.735001    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:32.189358 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:32.189317    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:33.795061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:33.795028    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:35.325545 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:35.325511    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:36.912287 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:36.912252    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:37.518783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:37.518746    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:38.520233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:38.520174    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:40.102675 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:40.102635    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:41.517907 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:41.517875    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:42.912824 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:42.912789    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:44.314846 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:44.314805    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:46.012948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:46.012789    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:47.290130 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:47.289017    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:43:47.577120 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:47.577010    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:43:47.782069 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:47.782016    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:43:47.826883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:47.826837    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:43:47.856143 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:47.856031    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:43:48.047610 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.047562    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:43:48.048954 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.048901    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:43:48.200135 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.200017    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:43:48.296079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.296016    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:43:48.297457 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.297428    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:43:48.484942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.484165    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"]
Oct 31 07:43:48.648103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.647507    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:43:48.648103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.647572    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"]
Oct 31 07:43:48.648103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.647616    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.697953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.697585    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.697953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.697700    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.697953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.697741    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.697953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.697779    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.697953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.697831    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.697953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.697895    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.698505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.697987    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.698505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.698025    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqc48\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-kube-api-access-dqc48\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.698505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.698084    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.815999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.808266    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.815999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.808375    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.815999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.808417    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqc48\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-kube-api-access-dqc48\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.815999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.808476    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.815999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.808551    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.815999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.808653    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.815999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.808684    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.815999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.808729    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.815999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.808786    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.850943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.847528    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.940044 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.851290    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.940295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.851792    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.940404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.851953    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.940509 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.852256    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.940605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.861203    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.940697 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.890814    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.940779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.903718    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqc48\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-kube-api-access-dqc48\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:48.953131 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:48.953092    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:49.148847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.148678    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"]
Oct 31 07:43:49.154523 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.154490    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.249938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.246311    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:49.257124 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.256934    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"]
Oct 31 07:43:49.337627 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.337510    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.337627 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.337584    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdkkx\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-kube-api-access-pdkkx\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.338848 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.337698    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.338848 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.337777    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.338848 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.337810    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.338848 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.338254    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.338848 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.338310    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.338848 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.338377    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32141a6a-3864-4ad1-92f5-ce680c399ebb-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.338848 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.338479    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.439604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.439371    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.439604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.439443    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.439604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.439482    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.439604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.439527    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.439604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.439591    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.440053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.439632    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32141a6a-3864-4ad1-92f5-ce680c399ebb-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.440053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.439705    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.440053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.439896    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.440053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.439938    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdkkx\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-kube-api-access-pdkkx\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.440053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.440026    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.440321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.440117    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.440364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.440341    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.440423 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.440401    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.440513 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.440495    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32141a6a-3864-4ad1-92f5-ce680c399ebb-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.442545 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.442521    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.442677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.442653    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.461418 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.461381    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.462139 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.462098    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdkkx\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-kube-api-access-pdkkx\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.561531 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.561497    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:49.590812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.590778    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"]
Oct 31 07:43:49.594195 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:43:49.594152    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbcd2d2a_6fb6_4466_983e_ad18f079a539.slice/crio-354c26642cda805c382ee7d840586c5ffd5ef8b341e8df6c22633916137c3707 WatchSource:0}: Error finding container 354c26642cda805c382ee7d840586c5ffd5ef8b341e8df6c22633916137c3707: Status 404 returned error can't find the container with id 354c26642cda805c382ee7d840586c5ffd5ef8b341e8df6c22633916137c3707
Oct 31 07:43:49.597242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.597210    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:49.597330 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.597275    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:49.597330 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.597302    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:49.893529 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.893494    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"]
Oct 31 07:43:49.898350 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:43:49.898308    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32141a6a_3864_4ad1_92f5_ce680c399ebb.slice/crio-d43df28958c4a6911e4f09f8ecdb5c8ce74de88d12b68b1d8dc242352692590f WatchSource:0}: Error finding container d43df28958c4a6911e4f09f8ecdb5c8ce74de88d12b68b1d8dc242352692590f: Status 404 returned error can't find the container with id d43df28958c4a6911e4f09f8ecdb5c8ce74de88d12b68b1d8dc242352692590f
Oct 31 07:43:49.901261 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.901220    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:49.901349 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.901289    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:49.901349 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:49.901322    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:43:50.155265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.155223    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:50.270427 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.270328    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" event={"ID":"cbcd2d2a-6fb6-4466-983e-ad18f079a539","Type":"ContainerStarted","Data":"a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a"}
Oct 31 07:43:50.270427 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.270397    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" event={"ID":"cbcd2d2a-6fb6-4466-983e-ad18f079a539","Type":"ContainerStarted","Data":"354c26642cda805c382ee7d840586c5ffd5ef8b341e8df6c22633916137c3707"}
Oct 31 07:43:50.272248 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.272219    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" event={"ID":"32141a6a-3864-4ad1-92f5-ce680c399ebb","Type":"ContainerStarted","Data":"9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd"}
Oct 31 07:43:50.272379 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.272264    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" event={"ID":"32141a6a-3864-4ad1-92f5-ce680c399ebb","Type":"ContainerStarted","Data":"d43df28958c4a6911e4f09f8ecdb5c8ce74de88d12b68b1d8dc242352692590f"}
Oct 31 07:43:50.312653 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.312589    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" podStartSLOduration=2.312566727 podStartE2EDuration="2.312566727s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:50.308638457 +0000 UTC m=+944.837833335" watchObservedRunningTime="2026-10-31 07:43:50.312566727 +0000 UTC m=+944.841761400"
Oct 31 07:43:50.348494 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.348429    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podStartSLOduration=1.348375533 podStartE2EDuration="1.348375533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:43:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:43:50.346619644 +0000 UTC m=+944.875814321" watchObservedRunningTime="2026-10-31 07:43:50.348375533 +0000 UTC m=+944.877570210"
Oct 31 07:43:50.565003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.563979    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:50.582007 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.578892    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 07:43:50.582007 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:50.578975    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 07:43:51.247558 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:51.247527    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:51.248486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:51.248461    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 07:43:51.248562 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:51.248511    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 07:43:51.565992 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:51.565397    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 07:43:51.565992 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:51.565471    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 07:43:51.770955 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:51.770590    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:52.247013 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:52.246976    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 07:43:52.247178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:52.247032    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 07:43:52.574004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:52.565315    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 07:43:52.574004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:52.565379    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 07:43:53.247305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:53.247247    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 07:43:53.247514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:53.247310    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 07:43:53.377941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:53.368449    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:53.571120 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:53.571031    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 07:43:53.571381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:53.571351    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 07:43:54.247934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:54.246962    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 07:43:54.247934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:54.247046    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 07:43:54.565420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:54.565314    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 07:43:54.565420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:54.565384    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 07:43:55.008942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:55.008837    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:55.247182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:55.247142    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 07:43:55.247352 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:55.247207    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 07:43:55.566938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:55.565343    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 07:43:55.566938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:55.565406    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 07:43:56.247291 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:56.247244    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Oct 31 07:43:56.247471 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:56.247319    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Oct 31 07:43:56.562875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:56.562787    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused" start-of-body=
Oct 31 07:43:56.562875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:56.562849    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": dial tcp 10.132.0.91:15021: connect: connection refused"
Oct 31 07:43:56.606253 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:56.606210    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:57.456360 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:57.456310    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:57.457375 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:57.457336    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:57.458235 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:57.458206    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:43:57.568535 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:57.568501    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:57.569908 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:57.569882    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:57.570795 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:57.570773    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:43:58.122993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:58.122960    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:58.710842 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:43:58.710798    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:43:58.717263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:58.717226    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:43:59.845820 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:43:59.845777    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:01.321507 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:01.321472    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:02.906028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:02.905983    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:03.742405 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.742360    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"]
Oct 31 07:44:03.747386 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.747365    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:03.768976 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.768940    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"]
Oct 31 07:44:03.854845 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.854812    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"]
Oct 31 07:44:03.859393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.859372    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:03.880883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.880850    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"]
Oct 31 07:44:03.917413 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.917378    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:03.917855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.917503    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:03.917855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.917582    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4gbr\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-kube-api-access-z4gbr\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:03.917855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.917630    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:03.917855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.917648    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:03.917855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.917813    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:03.917855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.917850    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:03.918087 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.917871    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:03.918087 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:03.917993    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.019398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.019299    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.019398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.019359    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8025aa84-ff53-40fe-8d4f-e6a681161d24-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.019639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.019472    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.020185 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.020153    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.020605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.020584    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.020794 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.020776    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdqdg\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-kube-api-access-tdqdg\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.020978 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.020959    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.021146 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.021131    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.021314 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.021300    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4gbr\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-kube-api-access-z4gbr\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.021451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.021433    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.022012 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.021986    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.022173 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.022153    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.022335 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.022317    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.022536 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.022516    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.022658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.022644    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.022759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.022744    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.022858 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.022845    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.023003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.022986    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.024275 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.024246    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.024456 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.022034    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.024722 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.024702    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.024787 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.024753    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.025022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.024998    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.033939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.026612    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.038023 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.037990    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.046985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.044566    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4gbr\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-kube-api-access-z4gbr\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.048431 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.048388    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.062567 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.062535    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:04.085319 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.085287    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"]
Oct 31 07:44:04.090116 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.090089    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.126820 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.126768    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.132192 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.132165    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"]
Oct 31 07:44:04.133742 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.133715    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.136464 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.136105    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.137193 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.137004    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.137193 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.137047    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.137193 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.137108    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.137193 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.137141    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8025aa84-ff53-40fe-8d4f-e6a681161d24-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.138707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.138001    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.138707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.138102    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdqdg\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-kube-api-access-tdqdg\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.138707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.138169    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.140486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.139809    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8025aa84-ff53-40fe-8d4f-e6a681161d24-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.140944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.140850    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.140944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.136772    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.141466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.141425    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.141786 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.141746    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.142103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.142070    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.162291 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.162258    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdqdg\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-kube-api-access-tdqdg\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.162953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.162886    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.173759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.173737    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:04.239966 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.239883    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.239966 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.239946    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.240138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.240105    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.240605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.240238    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.240605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.240288    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cv448\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-kube-api-access-cv448\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.240605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.240316    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.240605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.240371    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.240605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.240472    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.240605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.240499    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.341686 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.341594    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.341686 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.341651    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.341881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.341715    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.341881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.341756    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.341891    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.341948    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.341987    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342172 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.342071    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342172 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.342091    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-credential-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342172 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.342156    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cv448\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-kube-api-access-cv448\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342172 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.342165    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-certs\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.342287    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-data\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.342440    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-socket\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.342724 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.342707    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istiod-ca-cert\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.344300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.344276    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-podinfo\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.344405 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.344347    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-envoy\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.360079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.360047    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-token\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.360208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.360096    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cv448\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-kube-api-access-cv448\") pod \"e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") " pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.402502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.402458    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"]
Oct 31 07:44:04.405999 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:44:04.405969    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f2e69a_a921_4bcb_91bf_65144b3d2a7e.slice/crio-37d98550af308a3f1414ca8603f76395f7fd1049b0c48f8ae5754f9124516f57 WatchSource:0}: Error finding container 37d98550af308a3f1414ca8603f76395f7fd1049b0c48f8ae5754f9124516f57: Status 404 returned error can't find the container with id 37d98550af308a3f1414ca8603f76395f7fd1049b0c48f8ae5754f9124516f57
Oct 31 07:44:04.408508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.408473    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:04.408621 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.408555    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:04.408621 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.408604    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:04.440651 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.440621    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" event={"ID":"92f2e69a-a921-4bcb-91bf-65144b3d2a7e","Type":"ContainerStarted","Data":"37d98550af308a3f1414ca8603f76395f7fd1049b0c48f8ae5754f9124516f57"}
Oct 31 07:44:04.441847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.441809    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:04.482024 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.481990    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:04.492147 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.492112    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"]
Oct 31 07:44:04.494653 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:44:04.494630    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8025aa84_ff53_40fe_8d4f_e6a681161d24.slice/crio-d51ca7d2b43895e48303755d1de7c9af1dc2116f2de0bea539ba8b34bc52d787 WatchSource:0}: Error finding container d51ca7d2b43895e48303755d1de7c9af1dc2116f2de0bea539ba8b34bc52d787: Status 404 returned error can't find the container with id d51ca7d2b43895e48303755d1de7c9af1dc2116f2de0bea539ba8b34bc52d787
Oct 31 07:44:04.499259 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.498197    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:04.499259 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.498310    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:04.499259 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.498363    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:04.752527 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.752264    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"]
Oct 31 07:44:04.755483 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:44:04.755453    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6702c169_4f3d_4ae5_8477_6e0e3c8aff06.slice/crio-7c2502b48c9153f9744962c0d754a7bda2286203110912707aefe22eb97a4f05 WatchSource:0}: Error finding container 7c2502b48c9153f9744962c0d754a7bda2286203110912707aefe22eb97a4f05: Status 404 returned error can't find the container with id 7c2502b48c9153f9744962c0d754a7bda2286203110912707aefe22eb97a4f05
Oct 31 07:44:04.758246 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.758214    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:04.758333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.758295    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:04.758404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.758342    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:04.973218 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:04.973172    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:05.485495 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:05.485441    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" event={"ID":"8025aa84-ff53-40fe-8d4f-e6a681161d24","Type":"ContainerStarted","Data":"4573654de93764db060db7787208962636a4f32cb57b0e6d7830350d66b47a3e"}
Oct 31 07:44:05.485693 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:05.485526    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" event={"ID":"8025aa84-ff53-40fe-8d4f-e6a681161d24","Type":"ContainerStarted","Data":"d51ca7d2b43895e48303755d1de7c9af1dc2116f2de0bea539ba8b34bc52d787"}
Oct 31 07:44:05.490254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:05.490218    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" event={"ID":"92f2e69a-a921-4bcb-91bf-65144b3d2a7e","Type":"ContainerStarted","Data":"447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82"}
Oct 31 07:44:05.491977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:05.491945    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" event={"ID":"6702c169-4f3d-4ae5-8477-6e0e3c8aff06","Type":"ContainerStarted","Data":"1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137"}
Oct 31 07:44:05.492163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:05.492147    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" event={"ID":"6702c169-4f3d-4ae5-8477-6e0e3c8aff06","Type":"ContainerStarted","Data":"7c2502b48c9153f9744962c0d754a7bda2286203110912707aefe22eb97a4f05"}
Oct 31 07:44:05.610388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:05.610316    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podStartSLOduration=2.610296153 podStartE2EDuration="2.610296153s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:05.560423343 +0000 UTC m=+960.089618018" watchObservedRunningTime="2026-10-31 07:44:05.610296153 +0000 UTC m=+960.139490829"
Oct 31 07:44:05.629574 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:05.629496    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podStartSLOduration=2.629475608 podStartE2EDuration="2.629475608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:05.624798528 +0000 UTC m=+960.153993202" watchObservedRunningTime="2026-10-31 07:44:05.629475608 +0000 UTC m=+960.158670284"
Oct 31 07:44:05.726303 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:05.715224    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podStartSLOduration=1.715203969 podStartE2EDuration="1.715203969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:05.711143677 +0000 UTC m=+960.240338373" watchObservedRunningTime="2026-10-31 07:44:05.715203969 +0000 UTC m=+960.244398644"
Oct 31 07:44:06.064872 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.064832    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:06.065643 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.065616    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 07:44:06.065833 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.065808    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 07:44:06.185986 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.185949    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:06.188138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.188105    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 07:44:06.189552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.189513    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 07:44:06.443060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.442965    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:06.444366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.444344    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 07:44:06.444549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.444524    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 07:44:06.841314 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:06.841273    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:07.079941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:07.064784    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 07:44:07.079941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:07.064879    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 07:44:07.175003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:07.174510    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 07:44:07.175003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:07.174592    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 07:44:07.318986 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:07.318904    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:07.445002 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:07.444477    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 07:44:07.445002 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:07.444589    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 07:44:08.073937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:08.073379    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 07:44:08.073937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:08.073444    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 07:44:08.179865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:08.179282    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 07:44:08.179865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:08.179436    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 07:44:08.442802 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:08.442694    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 07:44:08.442802 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:08.442763    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 07:44:09.066951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:09.065131    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 07:44:09.066951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:09.065204    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 07:44:09.239937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:09.239188    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 07:44:09.239937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:09.239255    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 07:44:09.342000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:09.341874    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:09.446943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:09.443596    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 07:44:09.446943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:09.443659    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 07:44:09.550094 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:09.549994    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:10.012425 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:10.012389    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:10.063941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:10.063368    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 07:44:10.063941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:10.063437    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 07:44:10.177591 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:10.177552    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 07:44:10.177882 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:10.177853    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 07:44:10.198022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:10.197844    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:10.448006 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:10.442347    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 07:44:10.448006 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:10.442428    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 07:44:11.071513 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:11.071444    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 07:44:11.071872 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:11.071830    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 07:44:11.178830 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:11.178789    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 07:44:11.179143 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:11.179110    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 07:44:11.445422 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:11.445330    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 07:44:11.445683 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:11.445656    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 07:44:11.540834 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:11.540786    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:12.071356 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:12.071313    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Oct 31 07:44:12.071688 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:12.071658    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Oct 31 07:44:12.182948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:12.182506    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Oct 31 07:44:12.182948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:12.182577    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Oct 31 07:44:12.446396 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:12.446300    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Oct 31 07:44:12.446644 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:12.446618    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Oct 31 07:44:13.523939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:13.521745    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:13.662934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:13.660410    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 07:44:13.898302 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:13.898184    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:13.942112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:13.942059    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.074985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.061820    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.094627 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.094590    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:14.094885 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.094857    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.140942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.108032    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.360301 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.360255    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 07:44:14.369075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.369024    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:14.369361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.369328    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.378122 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.378084    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"]
Oct 31 07:44:14.385837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.385799    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:14.579942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.550322    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:14.610217 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.593566    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:14.610595 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.610493    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.659290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.659235    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-b4e8fd\"/\"distinct-2-w2-b4e8fd-kserve-self-signed-certs\""
Oct 31 07:44:14.682942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.681038    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.682942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.682768    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:44:14.687112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.687060    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.726088 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.726043    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.830939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.830056    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 31 07:44:14.882055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.872085    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:14.920664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.910228    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:14.952659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.951522    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:44:14.952659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:14.951581    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:15.086944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.054271    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:44:15.153996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.130769    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"]
Oct 31 07:44:15.175733 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.175681    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-model-cache\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.176075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.176029    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtmzt\" (UniqueName: \"kubernetes.io/projected/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-kube-api-access-jtmzt\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.176336 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.176315    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-home\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.176648 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.176624    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tls-certs\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.176860 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.176841    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tmp-dir\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.177162 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.177139    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-dshm\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.178426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.178392    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:15.313266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.195651    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 31 07:44:15.343109 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.198034    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:15.346593 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.346557    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tls-certs\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.346949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.346904    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tmp-dir\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.351302 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.351277    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-dshm\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.355171 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.355144    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-model-cache\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.389192 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.389038    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtmzt\" (UniqueName: \"kubernetes.io/projected/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-kube-api-access-jtmzt\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.389593 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.389555    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-home\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.390388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.317083    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:44:15.390621 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.390605    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:44:15.390806 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.390782    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:44:15.392062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.392044    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-home\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.392222 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.384249    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:15.396037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.395987    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:15.403989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.363599    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-model-cache\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.431967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.354006    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tmp-dir\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:15.432229 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.384295    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:15.583942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.558248    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:44:15.756951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.731021    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:15.947432 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.766893    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.777564    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.782302    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.784678    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-dshm\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.784704    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.099191    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.844664    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.845644    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtmzt\" (UniqueName: \"kubernetes.io/projected/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-kube-api-access-jtmzt\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.962311    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:15.883628    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tls-certs\") pod \"distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") " pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.023984    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.100105    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.100157    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:44:16.112996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.014009    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.176395 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.176265    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:16.323940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.304614    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.389759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.389644    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.468215 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.468167    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.490034 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.489984    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:16.490356 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.490310    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.509095 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.509048    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:44:16.580944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.580677    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 07:44:16.681490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.621981    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:44:16.681869 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.681543    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:44:16.809202 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.808311    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": context deadline exceeded"
Oct 31 07:44:16.939152 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.939047    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:16.939448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.939399    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:16.944846 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:16.944812    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:17.133404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.132292    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 31 07:44:17.133404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.132794    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": context deadline exceeded"
Oct 31 07:44:17.133404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.133104    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:17.156018 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.144598    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 31 07:44:17.388958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.176141    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:44:17.398100 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.398061    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:44:17.463500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.442032    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 31 07:44:17.463500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.181713    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:17.463500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.446287    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:17.463500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.332908    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:17.480612 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.480571    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:17.537948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.512157    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 31 07:44:17.547893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.547853    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:17.548156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.548124    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:17.590981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.582739    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:17.644773 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.644671    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 07:44:17.706940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.679562    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:17.734657 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.734611    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 07:44:17.930117 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.830784    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:17.930338 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:17.830828    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:18.416937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.408368    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main" probeResult="failure" output="Get \"https://10.132.0.70:8000/ready\": context deadline exceeded"
Oct 31 07:44:18.520939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.497271    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:18.541395 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.522828    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:18.541395 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.524535    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:18.541395 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.525294    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": context deadline exceeded"
Oct 31 07:44:18.553197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.545558    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 31 07:44:18.631977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.626602    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/health\": context deadline exceeded"
Oct 31 07:44:18.637708 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.635581    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 31 07:44:18.643881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.635390    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": context deadline exceeded"
Oct 31 07:44:18.644805 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.644713    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:44:18.648269 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.648236    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 07:44:18.678396 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.650405    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:44:18.704944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.695409    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:44:18.704944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.669409    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:18.704944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.696787    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:18.813981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.769666    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:44:18.813981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.769799    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:18.813981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.803889    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:44:18.948216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.943826    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main" probeResult="failure" output="Get \"https://10.132.0.85:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:18.948216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.945023    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 07:44:18.948216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.946117    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:44:18.993983 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.989507    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"]
Oct 31 07:44:18.993983 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:18.989635    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:44:19.007809 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.007775    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:44:19.009533 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.009500    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" event={"ID":"9be50c74-6e27-4c8c-a3ed-f1cdae35c303","Type":"ContainerStarted","Data":"0fa6ce9be8962731d4f5e6a02018be04cd40cac92eea04b609d4438138ca10a2"}
Oct 31 07:44:19.024753 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.021896    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:44:19.148893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.148856    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:19.150097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.150075    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:19.179218 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.179187    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:44:19.194343 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.194306    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:19.196401 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.196373    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:19.200731 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.200658    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:19.259448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.259416    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:44:19.270619 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.270589    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:44:19.270890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.270867    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:44:19.277623 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.277598    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:44:19.277813 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.277792    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:44:19.280544 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:19.280526    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:44:20.019438 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:20.019388    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" event={"ID":"9be50c74-6e27-4c8c-a3ed-f1cdae35c303","Type":"ContainerStarted","Data":"c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a"}
Oct 31 07:44:20.057448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:20.057391    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podStartSLOduration=6.057375037 podStartE2EDuration="6.057375037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:20.05541455 +0000 UTC m=+974.584609224" watchObservedRunningTime="2026-10-31 07:44:20.057375037 +0000 UTC m=+974.586569729"
Oct 31 07:44:20.178434 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:20.178396    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:20.534063 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:20.534033    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:22.023230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:22.023181    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:22.226875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:22.226839    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:23.575663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:23.575630    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:25.861103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:25.861065    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:26.178772 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:26.178682    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:26.192635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:26.192603    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:27.110485 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:27.110380    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:27.161338 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:27.161304    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"]
Oct 31 07:44:27.167585 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:27.167555    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"]
Oct 31 07:44:27.198637 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:27.198606    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"]
Oct 31 07:44:27.260337 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:27.260305    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:27.616582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:27.616547    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:28.696530 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:44:28.696489    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:44:29.124761 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:29.124719    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:30.792778 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:30.792732    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:32.321966 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:32.321937    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:33.040607 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.040567    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:33.227210 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.227159    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:33.592932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.592882    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"]
Oct 31 07:44:33.599824 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.599791    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.630786 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.630743    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.631186 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.631160    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.631542 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.631508    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.631639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.631575    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.631702 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.631656    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.631783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.631758    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.631902 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.631881    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.631995 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.631970    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zjnp\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-kube-api-access-2zjnp\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.632055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.632000    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.639364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.639334    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"]
Oct 31 07:44:33.659008 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.658970    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"]
Oct 31 07:44:33.664485 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.664297    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.684446 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.684416    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"]
Oct 31 07:44:33.733898 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.733821    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.734216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.733976    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.734216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734019    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjnp\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-kube-api-access-2zjnp\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.734216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734048    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.734216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734096    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.734216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734132    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.734216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734169    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.734618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734268    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.734618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734300    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.734618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734325    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.734618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734376    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.734618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734411    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tszc9\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-kube-api-access-tszc9\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.734618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734455    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.734618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734487    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.734618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734565    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.734618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734595    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.735101 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734651    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.735101 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.734731    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.741369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.741338    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-certs\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.741815 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.741794    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-credential-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.750050 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.750019    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-socket\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.750871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.750851    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istiod-ca-cert\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.752475 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.752432    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-data\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.761759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.761734    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-envoy\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.763587 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.763567    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-podinfo\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.770641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.770614    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zjnp\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-kube-api-access-2zjnp\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.776975 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.776766    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-token\") pod \"e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") " pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.840964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.840906    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.840981    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841010    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841057    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tszc9\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-kube-api-access-tszc9\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841097    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841160    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841210    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841314    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841404    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841593 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841439    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841777 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841729    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-credential-socket\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841777 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841758    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-certs\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841995 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841825    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-data\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.841995 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.841850    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istiod-ca-cert\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.843631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.843571    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-envoy\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.843741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.843724    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-podinfo\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.858788 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.858763    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-token\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.858973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.858954    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tszc9\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-kube-api-access-tszc9\") pod \"e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") " pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:33.932802 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.932765    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:33.984796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:33.984756    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:34.116866 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.116784    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:34.259698 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.259651    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"]
Oct 31 07:44:34.269042 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.268681    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"]
Oct 31 07:44:34.279211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.279176    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.286232 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.284730    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:34.286232 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.284840    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:34.286232 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.284901    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:34.309394 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.309350    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"]
Oct 31 07:44:34.329085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.329043    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"]
Oct 31 07:44:34.343736 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.343705    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:34.343859 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.343775    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:34.343859 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.343804    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:34.350837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.350806    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.351153 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.351127    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.351470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.351426    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5rfr\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-kube-api-access-t5rfr\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.351652 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.351632    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.351852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.351833    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1381d0c5-4a0d-4f52-9588-e5011ea39747-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.352834 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.352805    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.353126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.352868    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.353126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.353036    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.353126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.353081    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.454515 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.454470    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.454715 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.454657    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5rfr\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-kube-api-access-t5rfr\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.454715 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.454711    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.454843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.454734    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1381d0c5-4a0d-4f52-9588-e5011ea39747-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.454843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.454788    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.454843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.454823    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.455039 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.454875    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.455039 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.454908    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.455039 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.455016    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.455524 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.455497    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-data\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.457563 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.457517    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.457737 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.457687    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1381d0c5-4a0d-4f52-9588-e5011ea39747-istiod-ca-cert\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.458113 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.458069    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-credential-socket\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.458370 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.458352    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-certs\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.458906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.458835    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-podinfo\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.460782 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.460750    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-envoy\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.475672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.475639    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-token\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.477185 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.477161    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5rfr\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-kube-api-access-t5rfr\") pod \"e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") " pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.635454 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.635368    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:34.975672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:34.975627    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"]
Oct 31 07:44:35.016005 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:44:35.013839    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1381d0c5_4a0d_4f52_9588_e5011ea39747.slice/crio-cc1ed4d213685fd4a37e5b89adfa62e1f2f3de91d85d05d23bbccfd27ba4d214 WatchSource:0}: Error finding container cc1ed4d213685fd4a37e5b89adfa62e1f2f3de91d85d05d23bbccfd27ba4d214: Status 404 returned error can't find the container with id cc1ed4d213685fd4a37e5b89adfa62e1f2f3de91d85d05d23bbccfd27ba4d214
Oct 31 07:44:35.018392 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.018351    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:35.018512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.018476    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:35.018589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.018520    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:44:35.212316 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.212269    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" event={"ID":"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7","Type":"ContainerStarted","Data":"d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007"}
Oct 31 07:44:35.212797 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.212768    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" event={"ID":"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7","Type":"ContainerStarted","Data":"0feb4db91a1a5e9b77efe2f5cc5ea7d2d42a70570b1f7e0e5936249ba9241e89"}
Oct 31 07:44:35.216606 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.216575    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" event={"ID":"1381d0c5-4a0d-4f52-9588-e5011ea39747","Type":"ContainerStarted","Data":"cc1ed4d213685fd4a37e5b89adfa62e1f2f3de91d85d05d23bbccfd27ba4d214"}
Oct 31 07:44:35.218975 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.218936    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" event={"ID":"89d5021c-6cb7-4905-ae86-6a7cfca44a12","Type":"ContainerStarted","Data":"e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808"}
Oct 31 07:44:35.219242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.219210    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" event={"ID":"89d5021c-6cb7-4905-ae86-6a7cfca44a12","Type":"ContainerStarted","Data":"0a7c1a43cf1b1338f7d41803b95948a1e80403b2b8220f9bf764e29170efb2d8"}
Oct 31 07:44:35.271000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.262037    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" podStartSLOduration=2.2620167589999998 podStartE2EDuration="2.262016759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:35.251740842 +0000 UTC m=+989.780935517" watchObservedRunningTime="2026-10-31 07:44:35.262016759 +0000 UTC m=+989.791211434"
Oct 31 07:44:35.299277 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.299207    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" podStartSLOduration=2.29918568 podStartE2EDuration="2.29918568s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:35.29863489 +0000 UTC m=+989.827829557" watchObservedRunningTime="2026-10-31 07:44:35.29918568 +0000 UTC m=+989.828380358"
Oct 31 07:44:35.638256 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.638167    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"]
Oct 31 07:44:35.639541 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.638401    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq" podUID="b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" containerName="maas-api" containerID="cri-o://a4b44b75ed0c4c86f3f997d8c709661225b765bab7a805c3a3a1d468eb363b61" gracePeriod=30
Oct 31 07:44:35.723968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.723927    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:35.942000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.934320    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:35.942000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.937056    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 07:44:35.942000 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.937120    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 07:44:35.994980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.989486    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:35.999940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:35.995887    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 07:44:36.015068 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:36.015017    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 07:44:36.386974 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:36.383944    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" event={"ID":"1381d0c5-4a0d-4f52-9588-e5011ea39747","Type":"ContainerStarted","Data":"20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3"}
Oct 31 07:44:36.545692 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:36.545628    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podStartSLOduration=2.545610492 podStartE2EDuration="2.545610492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:36.54339471 +0000 UTC m=+991.072589385" watchObservedRunningTime="2026-10-31 07:44:36.545610492 +0000 UTC m=+991.074805168"
Oct 31 07:44:36.643487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:36.643396    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:36.644183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:36.644156    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 07:44:36.644414 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:36.644372    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 07:44:36.831075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:36.831034    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:36.948764 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:36.945476    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 07:44:36.948764 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:36.945534    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 07:44:37.029941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.005856    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 07:44:37.029941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.005955    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 07:44:37.472997 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.472954    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:37.485388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.485349    5039 generic.go:356] "Generic (PLEG): container finished" podID="b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" containerID="a4b44b75ed0c4c86f3f997d8c709661225b765bab7a805c3a3a1d468eb363b61" exitCode=0
Oct 31 07:44:37.485991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.485963    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq" event={"ID":"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a","Type":"ContainerDied","Data":"a4b44b75ed0c4c86f3f997d8c709661225b765bab7a805c3a3a1d468eb363b61"}
Oct 31 07:44:37.770096 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.770053    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 07:44:37.770743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.770706    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 07:44:37.934412 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.934384    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:44:37.935799 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.935758    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 07:44:37.936030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:37.936005    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 07:44:38.032055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.020668    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-maas-api-tls\") pod \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") "
Oct 31 07:44:38.032055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.020782    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-openshift-service-ca\") pod \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") "
Oct 31 07:44:38.032055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.020899    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-metrics-certs\") pod \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") "
Oct 31 07:44:38.032055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.021059    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-kube-api-access-mw8m5\" (UniqueName: \"kubernetes.io/projected/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-kube-api-access-mw8m5\") pod \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\" (UID: \"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a\") "
Oct 31 07:44:38.036191 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.036146    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-openshift-service-ca" pod "b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" (UID: "b7f1ec49-263c-46e5-bbb8-fd9d78d5651a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:44:38.040406 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.040373    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-metrics-certs" pod "b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" (UID: "b7f1ec49-263c-46e5-bbb8-fd9d78d5651a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:44:38.042322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.041891    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 07:44:38.042322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.041993    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 07:44:38.042528 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.042489    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-maas-api-tls" pod "b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" (UID: "b7f1ec49-263c-46e5-bbb8-fd9d78d5651a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:44:38.043096 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.043054    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-kube-api-access-mw8m5" pod "b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" (UID: "b7f1ec49-263c-46e5-bbb8-fd9d78d5651a"). InnerVolumeSpecName "kube-api-access-mw8m5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:38.148738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.138604    5039 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-openshift-service-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:38.148738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.138643    5039 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-metrics-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:38.148738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.138660    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mw8m5\" (UniqueName: \"kubernetes.io/projected/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-kube-api-access-mw8m5\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:38.148738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.138674    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a-maas-api-tls\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:38.401998 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.399582    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:38.637251 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.637214    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 07:44:38.640802 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.640765    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 07:44:38.671284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.665714    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"
Oct 31 07:44:38.671284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.668358    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq" event={"ID":"b7f1ec49-263c-46e5-bbb8-fd9d78d5651a","Type":"ContainerDied","Data":"156333281e3c890b9f053c22e608b6be313cb985ede973e590a12f5842ec68b2"}
Oct 31 07:44:38.671284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.668445    5039 scope.go:122] "RemoveContainer" containerID="a4b44b75ed0c4c86f3f997d8c709661225b765bab7a805c3a3a1d468eb363b61"
Oct 31 07:44:38.828026 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.827978    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"]
Oct 31 07:44:38.836346 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.836311    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-648fbe-7dbdc79fc6-mmhsq"]
Oct 31 07:44:38.933730 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.933401    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 07:44:38.933730 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.933469    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 07:44:38.989094 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.988578    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 07:44:38.989094 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:38.988649    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 07:44:39.256016 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:39.255976    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:39.637823 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:39.636375    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 07:44:39.637823 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:39.636441    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 07:44:39.637823 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:39.637156    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" path="/var/lib/kubelet/pods/b7f1ec49-263c-46e5-bbb8-fd9d78d5651a/volumes"
Oct 31 07:44:39.933687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:39.933578    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 07:44:39.933687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:39.933645    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 07:44:39.989955 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:39.986335    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 07:44:39.989955 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:39.986401    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 07:44:40.636573 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:40.636535    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 07:44:40.636772 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:40.636591    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 07:44:40.934241 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:40.934032    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 07:44:40.934241 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:40.934139    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 07:44:40.997557 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:40.997518    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Oct 31 07:44:40.997842 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:40.997813    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Oct 31 07:44:41.636170 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:41.636139    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 07:44:41.636352 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:41.636200    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 07:44:41.729189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:41.729138    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:41.934312 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:41.934204    5039 patch_prober.go:29] interesting pod/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Oct 31 07:44:41.934312 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:41.934274    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Oct 31 07:44:42.207835 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.204765    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main" containerID="cri-o://73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1" gracePeriod=45
Oct 31 07:44:42.207835 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.207092    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main" containerID="cri-o://c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74" gracePeriod=45
Oct 31 07:44:42.232904 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.232858    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main" containerID="cri-o://4be98311397443898707f26d71a8d9761d74bf0aaf84c742eb9f50830b217c88" gracePeriod=45
Oct 31 07:44:42.464988 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.463939    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main" probeResult="failure" output="Get \"https://10.132.0.73:8000/ready\": dial tcp 10.132.0.73:8000: connect: connection refused"
Oct 31 07:44:42.653934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.637105    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused" start-of-body=
Oct 31 07:44:42.653934 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.637170    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": dial tcp 10.132.0.98:15021: connect: connection refused"
Oct 31 07:44:42.719672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.716033    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:42.719672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.717292    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:42.720725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.720663    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:44:42.806099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.805628    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:44:42.806099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.807319    5039 generic.go:356] "Generic (PLEG): container finished" podID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerID="4be98311397443898707f26d71a8d9761d74bf0aaf84c742eb9f50830b217c88" exitCode=0
Oct 31 07:44:42.806099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.807548    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" event={"ID":"4a4c11ea-036c-4a3c-8d48-f484a49d152d","Type":"ContainerDied","Data":"4be98311397443898707f26d71a8d9761d74bf0aaf84c742eb9f50830b217c88"}
Oct 31 07:44:42.806099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.809988    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:44:42.806099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.811313    5039 generic.go:356] "Generic (PLEG): container finished" podID="e6feac23-1388-43c2-97a1-6f208ea245df" containerID="73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1" exitCode=0
Oct 31 07:44:42.813641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.811426    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" event={"ID":"e6feac23-1388-43c2-97a1-6f208ea245df","Type":"ContainerDied","Data":"73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1"}
Oct 31 07:44:42.813641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.811459    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt" event={"ID":"e6feac23-1388-43c2-97a1-6f208ea245df","Type":"ContainerDied","Data":"bce89f566036597308b7e7daf95cc24889be6abba9a04b2c4ae0675a64aa6185"}
Oct 31 07:44:42.813641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.811483    5039 scope.go:122] "RemoveContainer" containerID="73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1"
Oct 31 07:44:42.813641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.811609    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"
Oct 31 07:44:42.815201 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.815170    5039 generic.go:356] "Generic (PLEG): container finished" podID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerID="c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74" exitCode=0
Oct 31 07:44:42.820124 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.818065    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"
Oct 31 07:44:42.820124 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.818212    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" event={"ID":"0640587b-51a9-427b-b891-dd0ff80d1d23","Type":"ContainerDied","Data":"c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74"}
Oct 31 07:44:42.820124 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.818246    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg" event={"ID":"0640587b-51a9-427b-b891-dd0ff80d1d23","Type":"ContainerDied","Data":"955306dd5965f13dce0d2ce35b91ec55e2df8bfac117698846f085a8a0ed9601"}
Oct 31 07:44:42.833310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.833235    5039 scope.go:122] "RemoveContainer" containerID="73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1"
Oct 31 07:44:42.833660 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:44:42.833638    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1\": container with ID starting with 73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1 not found: ID does not exist" containerID="73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1"
Oct 31 07:44:42.833747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.833671    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1"} err="failed to get container status \"73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1\": rpc error: code = NotFound desc = could not find container \"73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1\": container with ID starting with 73591ab24146425bbd606cc7e2dc5e71381a949ad3fa1aef15f77a9ae4a0e7a1 not found: ID does not exist"
Oct 31 07:44:42.833747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.833696    5039 scope.go:122] "RemoveContainer" containerID="c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74"
Oct 31 07:44:42.850906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.850881    5039 scope.go:122] "RemoveContainer" containerID="c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74"
Oct 31 07:44:42.851508 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:44:42.851443    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74\": container with ID starting with c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74 not found: ID does not exist" containerID="c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74"
Oct 31 07:44:42.851508 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.851478    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74"} err="failed to get container status \"c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74\": rpc error: code = NotFound desc = could not find container \"c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74\": container with ID starting with c509c3e26ca306a00f8b0bcd64559fa916f270e647374838dc3e024b46229a74 not found: ID does not exist"
Oct 31 07:44:42.851868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.851800    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:44:42.922559 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922523    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-model-cache\") pod \"e6feac23-1388-43c2-97a1-6f208ea245df\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") "
Oct 31 07:44:42.922744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922574    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-dshm\") pod \"e6feac23-1388-43c2-97a1-6f208ea245df\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") "
Oct 31 07:44:42.922744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922610    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e6feac23-1388-43c2-97a1-6f208ea245df-tls-certs\" (UniqueName: \"kubernetes.io/secret/e6feac23-1388-43c2-97a1-6f208ea245df-tls-certs\") pod \"e6feac23-1388-43c2-97a1-6f208ea245df\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") "
Oct 31 07:44:42.922744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922671    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e6feac23-1388-43c2-97a1-6f208ea245df-kube-api-access-kzsfx\" (UniqueName: \"kubernetes.io/projected/e6feac23-1388-43c2-97a1-6f208ea245df-kube-api-access-kzsfx\") pod \"e6feac23-1388-43c2-97a1-6f208ea245df\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") "
Oct 31 07:44:42.922744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922713    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-home\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-home\") pod \"0640587b-51a9-427b-b891-dd0ff80d1d23\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") "
Oct 31 07:44:42.922989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922758    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0640587b-51a9-427b-b891-dd0ff80d1d23-kube-api-access-g267r\" (UniqueName: \"kubernetes.io/projected/0640587b-51a9-427b-b891-dd0ff80d1d23-kube-api-access-g267r\") pod \"0640587b-51a9-427b-b891-dd0ff80d1d23\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") "
Oct 31 07:44:42.922989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922781    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-tmp-dir\") pod \"e6feac23-1388-43c2-97a1-6f208ea245df\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") "
Oct 31 07:44:42.922989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922829    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-home\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-home\") pod \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") "
Oct 31 07:44:42.922989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922872    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-model-cache\") pod \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") "
Oct 31 07:44:42.922989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922908    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0640587b-51a9-427b-b891-dd0ff80d1d23-tls-certs\" (UniqueName: \"kubernetes.io/secret/0640587b-51a9-427b-b891-dd0ff80d1d23-tls-certs\") pod \"0640587b-51a9-427b-b891-dd0ff80d1d23\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") "
Oct 31 07:44:42.922989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922948    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-dshm\") pod \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") "
Oct 31 07:44:42.922989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.922978    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-model-cache\") pod \"0640587b-51a9-427b-b891-dd0ff80d1d23\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") "
Oct 31 07:44:42.923263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923009    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tls-certs\") pod \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") "
Oct 31 07:44:42.923263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923034    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-tmp-dir\") pod \"0640587b-51a9-427b-b891-dd0ff80d1d23\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") "
Oct 31 07:44:42.923263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923062    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tmp-dir\") pod \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") "
Oct 31 07:44:42.923263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923079    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-home\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-home\") pod \"e6feac23-1388-43c2-97a1-6f208ea245df\" (UID: \"e6feac23-1388-43c2-97a1-6f208ea245df\") "
Oct 31 07:44:42.923263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923104    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-dshm\") pod \"0640587b-51a9-427b-b891-dd0ff80d1d23\" (UID: \"0640587b-51a9-427b-b891-dd0ff80d1d23\") "
Oct 31 07:44:42.923263 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923128    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4a4c11ea-036c-4a3c-8d48-f484a49d152d-kube-api-access-8p8wh\" (UniqueName: \"kubernetes.io/projected/4a4c11ea-036c-4a3c-8d48-f484a49d152d-kube-api-access-8p8wh\") pod \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\" (UID: \"4a4c11ea-036c-4a3c-8d48-f484a49d152d\") "
Oct 31 07:44:42.923807 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923707    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-model-cache" pod "0640587b-51a9-427b-b891-dd0ff80d1d23" (UID: "0640587b-51a9-427b-b891-dd0ff80d1d23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.923807 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923708    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tmp-dir" pod "4a4c11ea-036c-4a3c-8d48-f484a49d152d" (UID: "4a4c11ea-036c-4a3c-8d48-f484a49d152d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.924132 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923975    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-home" pod "e6feac23-1388-43c2-97a1-6f208ea245df" (UID: "e6feac23-1388-43c2-97a1-6f208ea245df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.924132 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923983    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-home" pod "0640587b-51a9-427b-b891-dd0ff80d1d23" (UID: "0640587b-51a9-427b-b891-dd0ff80d1d23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.924244 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.923872    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-tmp-dir" pod "e6feac23-1388-43c2-97a1-6f208ea245df" (UID: "e6feac23-1388-43c2-97a1-6f208ea245df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.924507 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.924415    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-model-cache" pod "e6feac23-1388-43c2-97a1-6f208ea245df" (UID: "e6feac23-1388-43c2-97a1-6f208ea245df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.924818 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.924629    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-tmp-dir" pod "0640587b-51a9-427b-b891-dd0ff80d1d23" (UID: "0640587b-51a9-427b-b891-dd0ff80d1d23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.925246 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.924977    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-home" pod "4a4c11ea-036c-4a3c-8d48-f484a49d152d" (UID: "4a4c11ea-036c-4a3c-8d48-f484a49d152d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.925338 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.925288    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-model-cache" pod "4a4c11ea-036c-4a3c-8d48-f484a49d152d" (UID: "4a4c11ea-036c-4a3c-8d48-f484a49d152d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.926983 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.926954    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-dshm" pod "e6feac23-1388-43c2-97a1-6f208ea245df" (UID: "e6feac23-1388-43c2-97a1-6f208ea245df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.927089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.927065    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-dshm" pod "4a4c11ea-036c-4a3c-8d48-f484a49d152d" (UID: "4a4c11ea-036c-4a3c-8d48-f484a49d152d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.929028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.929005    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0640587b-51a9-427b-b891-dd0ff80d1d23-tls-certs" pod "0640587b-51a9-427b-b891-dd0ff80d1d23" (UID: "0640587b-51a9-427b-b891-dd0ff80d1d23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:44:42.929298 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.929255    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6feac23-1388-43c2-97a1-6f208ea245df-tls-certs" pod "e6feac23-1388-43c2-97a1-6f208ea245df" (UID: "e6feac23-1388-43c2-97a1-6f208ea245df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:44:42.929484 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.929460    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-dshm" pod "0640587b-51a9-427b-b891-dd0ff80d1d23" (UID: "0640587b-51a9-427b-b891-dd0ff80d1d23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:42.929724 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.929677    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0640587b-51a9-427b-b891-dd0ff80d1d23-kube-api-access-g267r" pod "0640587b-51a9-427b-b891-dd0ff80d1d23" (UID: "0640587b-51a9-427b-b891-dd0ff80d1d23"). InnerVolumeSpecName "kube-api-access-g267r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:42.929898 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.929872    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tls-certs" pod "4a4c11ea-036c-4a3c-8d48-f484a49d152d" (UID: "4a4c11ea-036c-4a3c-8d48-f484a49d152d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:44:42.930371 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.930345    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6feac23-1388-43c2-97a1-6f208ea245df-kube-api-access-kzsfx" pod "e6feac23-1388-43c2-97a1-6f208ea245df" (UID: "e6feac23-1388-43c2-97a1-6f208ea245df"). InnerVolumeSpecName "kube-api-access-kzsfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:42.931018 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.930988    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a4c11ea-036c-4a3c-8d48-f484a49d152d-kube-api-access-8p8wh" pod "4a4c11ea-036c-4a3c-8d48-f484a49d152d" (UID: "4a4c11ea-036c-4a3c-8d48-f484a49d152d"). InnerVolumeSpecName "kube-api-access-8p8wh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:42.940704 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.939319    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:42.940704 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.940566    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:42.942685 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:42.942230    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:44:43.026178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026083    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026119    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026133    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6feac23-1388-43c2-97a1-6f208ea245df-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026145    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzsfx\" (UniqueName: \"kubernetes.io/projected/e6feac23-1388-43c2-97a1-6f208ea245df-kube-api-access-kzsfx\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026160    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026177    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g267r\" (UniqueName: \"kubernetes.io/projected/0640587b-51a9-427b-b891-dd0ff80d1d23-kube-api-access-g267r\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026191    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026205    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026216    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026228    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0640587b-51a9-427b-b891-dd0ff80d1d23-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026240    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026252    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026264    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026277    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026289    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a4c11ea-036c-4a3c-8d48-f484a49d152d-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026300    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6feac23-1388-43c2-97a1-6f208ea245df-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026312    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0640587b-51a9-427b-b891-dd0ff80d1d23-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.026592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.026324    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p8wh\" (UniqueName: \"kubernetes.io/projected/4a4c11ea-036c-4a3c-8d48-f484a49d152d-kube-api-access-8p8wh\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:43.157524 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.157472    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"]
Oct 31 07:44:43.163265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.163203    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/premium-w6-027d2a-kserve-77f56ffb48-74lkt"]
Oct 31 07:44:43.195208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.195167    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"]
Oct 31 07:44:43.199237 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.199207    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/distinct-w6-027d2a-kserve-775f5cd64c-grrrg"]
Oct 31 07:44:43.619045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.619011    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" path="/var/lib/kubelet/pods/0640587b-51a9-427b-b891-dd0ff80d1d23/volumes"
Oct 31 07:44:43.619548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.619526    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" path="/var/lib/kubelet/pods/e6feac23-1388-43c2-97a1-6f208ea245df/volumes"
Oct 31 07:44:43.827256 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.827227    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"
Oct 31 07:44:43.827424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.827226    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz" event={"ID":"4a4c11ea-036c-4a3c-8d48-f484a49d152d","Type":"ContainerDied","Data":"7310f53037b627a7d42b29bf69df99c531ca33d6de5476bf86eec3ceaa6923d7"}
Oct 31 07:44:43.827424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.827380    5039 scope.go:122] "RemoveContainer" containerID="4be98311397443898707f26d71a8d9761d74bf0aaf84c742eb9f50830b217c88"
Oct 31 07:44:43.847005 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.846973    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:43.857258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.857229    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:43.857706 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.857626    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:43.859347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.859314    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:44:43.877112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.877016    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"]
Oct 31 07:44:43.888103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:43.888069    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-027d2a/simulator-w6-027d2a-kserve-76f8b7bbdf-8kprz"]
Oct 31 07:44:44.217052 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:44.217017    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:44.598017 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:44.597910    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:44.820339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:44.820307    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:44.937444 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:44.937025    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"]
Oct 31 07:44:44.937444 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:44.937304    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy" containerID="cri-o://c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3" gracePeriod=30
Oct 31 07:44:44.957786 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:44.957744    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"]
Oct 31 07:44:44.958056 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:44.958019    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy" containerID="cri-o://5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626" gracePeriod=30
Oct 31 07:44:44.961070 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:44.961040    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"]
Oct 31 07:44:44.961281 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:44.961257    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" containerID="cri-o://1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137" gracePeriod=30
Oct 31 07:44:45.031362 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:45.031323    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:45.635206 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:45.635168    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" path="/var/lib/kubelet/pods/4a4c11ea-036c-4a3c-8d48-f484a49d152d/volumes"
Oct 31 07:44:46.700060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:46.700013    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"]
Oct 31 07:44:46.709453 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:46.709415    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"]
Oct 31 07:44:46.834215 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:46.831910    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:47.031379 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:47.031343    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:47.745110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:47.745074    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:48.911757 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:48.911721    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:49.199747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:49.199664    5039 patch_prober.go:29] interesting pod/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 07:44:49.199747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:49.199725    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:44:50.296730 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.281924    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:44:50.311418 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.311388    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:50.367224 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.367196    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:44:50.369433 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369399    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-kube-api-access-bgnq4\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-kube-api-access-bgnq4\") pod \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") "
Oct 31 07:44:50.369595 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369570    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-socket\") pod \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") "
Oct 31 07:44:50.369702 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369684    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-istio-token\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-istio-token\") pod \"35afb827-a07f-46ee-9994-d893a25527ca\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") "
Oct 31 07:44:50.369782 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369722    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-certs\") pod \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") "
Oct 31 07:44:50.369782 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369753    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-envoy\") pod \"35afb827-a07f-46ee-9994-d893a25527ca\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") "
Oct 31 07:44:50.369891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369782    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-kube-api-access-cv448\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-kube-api-access-cv448\") pod \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") "
Oct 31 07:44:50.369891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369823    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-certs\") pod \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") "
Oct 31 07:44:50.369891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369859    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-data\") pod \"35afb827-a07f-46ee-9994-d893a25527ca\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") "
Oct 31 07:44:50.369891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369888    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-credential-socket\") pod \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") "
Oct 31 07:44:50.370184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369966    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istiod-ca-cert\") pod \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") "
Oct 31 07:44:50.370184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.369996    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-certs\") pod \"35afb827-a07f-46ee-9994-d893a25527ca\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") "
Oct 31 07:44:50.370184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370031    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-podinfo\") pod \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") "
Oct 31 07:44:50.370184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370079    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-socket\") pod \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") "
Oct 31 07:44:50.370184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370108    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-data\") pod \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") "
Oct 31 07:44:50.370184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370173    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-kube-api-access-5zvvn\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-kube-api-access-5zvvn\") pod \"35afb827-a07f-46ee-9994-d893a25527ca\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") "
Oct 31 07:44:50.370486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370204    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/35afb827-a07f-46ee-9994-d893a25527ca-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35afb827-a07f-46ee-9994-d893a25527ca-istiod-ca-cert\") pod \"35afb827-a07f-46ee-9994-d893a25527ca\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") "
Oct 31 07:44:50.370486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370237    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-token\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-token\") pod \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") "
Oct 31 07:44:50.370486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370267    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-data\") pod \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") "
Oct 31 07:44:50.370486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370319    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-socket\") pod \"35afb827-a07f-46ee-9994-d893a25527ca\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") "
Oct 31 07:44:50.370486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370352    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-credential-socket\") pod \"35afb827-a07f-46ee-9994-d893a25527ca\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") "
Oct 31 07:44:50.370486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370381    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-credential-socket" pod "6702c169-4f3d-4ae5-8477-6e0e3c8aff06" (UID: "6702c169-4f3d-4ae5-8477-6e0e3c8aff06"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.370486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370422    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-envoy\") pod \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") "
Oct 31 07:44:50.370486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370480    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istiod-ca-cert\") pod \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") "
Oct 31 07:44:50.370891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370515    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-podinfo\") pod \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\" (UID: \"6702c169-4f3d-4ae5-8477-6e0e3c8aff06\") "
Oct 31 07:44:50.370891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370557    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-envoy\") pod \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") "
Oct 31 07:44:50.370891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370844    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-certs" pod "6702c169-4f3d-4ae5-8477-6e0e3c8aff06" (UID: "6702c169-4f3d-4ae5-8477-6e0e3c8aff06"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.370891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370856    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-certs" pod "35afb827-a07f-46ee-9994-d893a25527ca" (UID: "35afb827-a07f-46ee-9994-d893a25527ca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.371119 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.371013    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-data" pod "6702c169-4f3d-4ae5-8477-6e0e3c8aff06" (UID: "6702c169-4f3d-4ae5-8477-6e0e3c8aff06"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.371408 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.370587    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-credential-socket\") pod \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") "
Oct 31 07:44:50.371928 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.371894    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-data" pod "8a0edf1c-3207-446b-9dfa-ffd9525690bd" (UID: "8a0edf1c-3207-446b-9dfa-ffd9525690bd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.372084 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372065    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-socket" pod "35afb827-a07f-46ee-9994-d893a25527ca" (UID: "35afb827-a07f-46ee-9994-d893a25527ca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.372191 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372167    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.372256 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372201    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.372256 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372217    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.372256 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372231    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.372256 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372245    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.372451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372257    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.372451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372278    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-credential-socket" pod "35afb827-a07f-46ee-9994-d893a25527ca" (UID: "35afb827-a07f-46ee-9994-d893a25527ca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.372560 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372504    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istiod-ca-cert" pod "8a0edf1c-3207-446b-9dfa-ffd9525690bd" (UID: "8a0edf1c-3207-446b-9dfa-ffd9525690bd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:44:50.373104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372629    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-socket" pod "8a0edf1c-3207-446b-9dfa-ffd9525690bd" (UID: "8a0edf1c-3207-446b-9dfa-ffd9525690bd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.373104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372653    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istiod-ca-cert" pod "6702c169-4f3d-4ae5-8477-6e0e3c8aff06" (UID: "6702c169-4f3d-4ae5-8477-6e0e3c8aff06"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:44:50.373104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372664    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-certs" pod "8a0edf1c-3207-446b-9dfa-ffd9525690bd" (UID: "8a0edf1c-3207-446b-9dfa-ffd9525690bd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.373104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372691    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-socket" pod "6702c169-4f3d-4ae5-8477-6e0e3c8aff06" (UID: "6702c169-4f3d-4ae5-8477-6e0e3c8aff06"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.373104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.372872    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-data" pod "35afb827-a07f-46ee-9994-d893a25527ca" (UID: "35afb827-a07f-46ee-9994-d893a25527ca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.373104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.373065    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-credential-socket" pod "8a0edf1c-3207-446b-9dfa-ffd9525690bd" (UID: "8a0edf1c-3207-446b-9dfa-ffd9525690bd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.373471 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.373335    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35afb827-a07f-46ee-9994-d893a25527ca-istiod-ca-cert" pod "35afb827-a07f-46ee-9994-d893a25527ca" (UID: "35afb827-a07f-46ee-9994-d893a25527ca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:44:50.375042 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.375021    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-kube-api-access-bgnq4" pod "8a0edf1c-3207-446b-9dfa-ffd9525690bd" (UID: "8a0edf1c-3207-446b-9dfa-ffd9525690bd"). InnerVolumeSpecName "kube-api-access-bgnq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:50.376486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.376450    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-envoy" pod "8a0edf1c-3207-446b-9dfa-ffd9525690bd" (UID: "8a0edf1c-3207-446b-9dfa-ffd9525690bd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.376681 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.376652    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-token" pod "6702c169-4f3d-4ae5-8477-6e0e3c8aff06" (UID: "6702c169-4f3d-4ae5-8477-6e0e3c8aff06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:50.376781 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.376752    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-envoy" pod "6702c169-4f3d-4ae5-8477-6e0e3c8aff06" (UID: "6702c169-4f3d-4ae5-8477-6e0e3c8aff06"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.377073 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.377037    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-envoy" pod "35afb827-a07f-46ee-9994-d893a25527ca" (UID: "35afb827-a07f-46ee-9994-d893a25527ca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:44:50.377277 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.377252    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-podinfo" pod "8a0edf1c-3207-446b-9dfa-ffd9525690bd" (UID: "8a0edf1c-3207-446b-9dfa-ffd9525690bd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:44:50.377381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.377255    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-istio-token" pod "35afb827-a07f-46ee-9994-d893a25527ca" (UID: "35afb827-a07f-46ee-9994-d893a25527ca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:50.377381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.377331    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-kube-api-access-5zvvn" pod "35afb827-a07f-46ee-9994-d893a25527ca" (UID: "35afb827-a07f-46ee-9994-d893a25527ca"). InnerVolumeSpecName "kube-api-access-5zvvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:50.377381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.377340    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-kube-api-access-cv448" pod "6702c169-4f3d-4ae5-8477-6e0e3c8aff06" (UID: "6702c169-4f3d-4ae5-8477-6e0e3c8aff06"). InnerVolumeSpecName "kube-api-access-cv448". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:50.378542 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.378408    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-podinfo" pod "6702c169-4f3d-4ae5-8477-6e0e3c8aff06" (UID: "6702c169-4f3d-4ae5-8477-6e0e3c8aff06"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:44:50.473088 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473055    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-token\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-token\") pod \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\" (UID: \"8a0edf1c-3207-446b-9dfa-ffd9525690bd\") "
Oct 31 07:44:50.473317 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473110    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/35afb827-a07f-46ee-9994-d893a25527ca-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35afb827-a07f-46ee-9994-d893a25527ca-istio-podinfo\") pod \"35afb827-a07f-46ee-9994-d893a25527ca\" (UID: \"35afb827-a07f-46ee-9994-d893a25527ca\") "
Oct 31 07:44:50.473883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473854    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.473883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473880    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473889    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473899    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cv448\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-kube-api-access-cv448\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473908    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473951    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473986    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.473995    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474006    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474014    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zvvn\" (UniqueName: \"kubernetes.io/projected/35afb827-a07f-46ee-9994-d893a25527ca-kube-api-access-5zvvn\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474022    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35afb827-a07f-46ee-9994-d893a25527ca-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474030    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474038    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35afb827-a07f-46ee-9994-d893a25527ca-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474046    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474054    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474062    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6702c169-4f3d-4ae5-8477-6e0e3c8aff06-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474071    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474078    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a0edf1c-3207-446b-9dfa-ffd9525690bd-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.474097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.474086    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgnq4\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-kube-api-access-bgnq4\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.475634 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.475606    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-token" pod "8a0edf1c-3207-446b-9dfa-ffd9525690bd" (UID: "8a0edf1c-3207-446b-9dfa-ffd9525690bd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:44:50.475757 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.475739    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35afb827-a07f-46ee-9994-d893a25527ca-istio-podinfo" pod "35afb827-a07f-46ee-9994-d893a25527ca" (UID: "35afb827-a07f-46ee-9994-d893a25527ca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:44:50.575563 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.575482    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a0edf1c-3207-446b-9dfa-ffd9525690bd-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.575563 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.575511    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35afb827-a07f-46ee-9994-d893a25527ca-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:44:50.891240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.891155    5039 generic.go:356] "Generic (PLEG): container finished" podID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerID="c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3" exitCode=0
Oct 31 07:44:50.891240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.891203    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"
Oct 31 07:44:50.891448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.891238    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" event={"ID":"8a0edf1c-3207-446b-9dfa-ffd9525690bd","Type":"ContainerDied","Data":"c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3"}
Oct 31 07:44:50.891448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.891287    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg" event={"ID":"8a0edf1c-3207-446b-9dfa-ffd9525690bd","Type":"ContainerDied","Data":"7e9e0839bcb92919c6354034b1c313d957dc5c99f517295c34eb048986af7fcd"}
Oct 31 07:44:50.891448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.891312    5039 scope.go:122] "RemoveContainer" containerID="c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3"
Oct 31 07:44:50.892871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.892848    5039 generic.go:356] "Generic (PLEG): container finished" podID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerID="1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137" exitCode=0
Oct 31 07:44:50.893086 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.892877    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" event={"ID":"6702c169-4f3d-4ae5-8477-6e0e3c8aff06","Type":"ContainerDied","Data":"1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137"}
Oct 31 07:44:50.893086 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.892902    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"
Oct 31 07:44:50.893086 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.892949    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4" event={"ID":"6702c169-4f3d-4ae5-8477-6e0e3c8aff06","Type":"ContainerDied","Data":"7c2502b48c9153f9744962c0d754a7bda2286203110912707aefe22eb97a4f05"}
Oct 31 07:44:50.894717 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.894691    5039 generic.go:356] "Generic (PLEG): container finished" podID="35afb827-a07f-46ee-9994-d893a25527ca" containerID="5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626" exitCode=0
Oct 31 07:44:50.894823 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.894737    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" event={"ID":"35afb827-a07f-46ee-9994-d893a25527ca","Type":"ContainerDied","Data":"5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626"}
Oct 31 07:44:50.894823 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.894746    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"
Oct 31 07:44:50.894823 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.894778    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr" event={"ID":"35afb827-a07f-46ee-9994-d893a25527ca","Type":"ContainerDied","Data":"c7b49602f45693490f629113255f2bc46c513ab58972f6b0392d7990eb667154"}
Oct 31 07:44:50.904549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.904529    5039 scope.go:122] "RemoveContainer" containerID="c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3"
Oct 31 07:44:50.904955 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:44:50.904888    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3\": container with ID starting with c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3 not found: ID does not exist" containerID="c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3"
Oct 31 07:44:50.905056 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.904966    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3"} err="failed to get container status \"c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3\": rpc error: code = NotFound desc = could not find container \"c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3\": container with ID starting with c1552095e856e658f0891f3de13c2b8bc8702441ab419ca4096673d1756e1eb3 not found: ID does not exist"
Oct 31 07:44:50.905056 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.904987    5039 scope.go:122] "RemoveContainer" containerID="1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137"
Oct 31 07:44:50.915158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.915138    5039 scope.go:122] "RemoveContainer" containerID="1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137"
Oct 31 07:44:50.915444 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:44:50.915425    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137\": container with ID starting with 1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137 not found: ID does not exist" containerID="1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137"
Oct 31 07:44:50.915510 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.915455    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137"} err="failed to get container status \"1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137\": rpc error: code = NotFound desc = could not find container \"1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137\": container with ID starting with 1ce56622c700020aeb409f65c408b5d5a3fb20c84ab8bcd83448334639c34137 not found: ID does not exist"
Oct 31 07:44:50.915510 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.915478    5039 scope.go:122] "RemoveContainer" containerID="5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626"
Oct 31 07:44:50.924980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.924958    5039 scope.go:122] "RemoveContainer" containerID="5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626"
Oct 31 07:44:50.925256 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:44:50.925237    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626\": container with ID starting with 5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626 not found: ID does not exist" containerID="5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626"
Oct 31 07:44:50.925320 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.925264    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626"} err="failed to get container status \"5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626\": rpc error: code = NotFound desc = could not find container \"5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626\": container with ID starting with 5767db8a08762ac5a54dce5c42fd1a916f2c0bbbfbb3bc6f91ea3c65bb878626 not found: ID does not exist"
Oct 31 07:44:50.972209 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.972182    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"]
Oct 31 07:44:50.982824 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:50.982793    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-kgncg"]
Oct 31 07:44:51.008436 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:51.008400    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"]
Oct 31 07:44:51.012983 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:51.012953    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-6xhbr"]
Oct 31 07:44:51.043739 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:51.043702    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"]
Oct 31 07:44:51.050278 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:51.050245    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-648fbe-openshift-default-889c4889f-257h4"]
Oct 31 07:44:51.158273 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:51.158179    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:51.357376 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:51.357340    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:51.619721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:51.619690    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="35afb827-a07f-46ee-9994-d893a25527ca" path="/var/lib/kubelet/pods/35afb827-a07f-46ee-9994-d893a25527ca/volumes"
Oct 31 07:44:51.620315 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:51.620290    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" path="/var/lib/kubelet/pods/6702c169-4f3d-4ae5-8477-6e0e3c8aff06/volumes"
Oct 31 07:44:51.621059 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:51.621035    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" path="/var/lib/kubelet/pods/8a0edf1c-3207-446b-9dfa-ffd9525690bd/volumes"
Oct 31 07:44:52.859938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:52.856713    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:53.111989 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:53.110999    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:54.065941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:54.064895    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:54.273942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:54.272887    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:54.277940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:54.274142    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 07:44:54.277940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:54.274864    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:54.298942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:54.297589    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": context deadline exceeded"
Oct 31 07:44:54.408996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:54.407997    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": context deadline exceeded"
Oct 31 07:44:54.535940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:54.535008    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:54.552053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:54.552001    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:54.843940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:54.843014    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:55.120999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.119020    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:55.150942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.136025    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:55.277940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.277080    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 07:44:55.277940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.277594    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:55.282085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.278341    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:44:55.282085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.278400    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:44:55.282085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.279789    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:55.282085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.280126    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:44:55.305941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.301391    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:55.305941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.301884    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:44:55.437997 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.437127    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:55.437997 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.437563    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:44:55.456944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.453842    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:55.548619 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.546801    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:55.548619 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.547618    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:44:55.560499 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.560392    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:55.604354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.604303    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:44:55.941948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:55.935074    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:56.151944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.139106    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:56.362941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.362421    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 07:44:56.501096 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.501049    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" probeResult="failure" output="Get \"https://10.132.0.82:8000/ready\": context deadline exceeded"
Oct 31 07:44:56.501542 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.501503    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": context deadline exceeded"
Oct 31 07:44:56.546310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.546248    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main" probeResult="failure" output="Get \"https://10.132.0.77:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:56.700959 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.463222    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" probeResult="failure" output="Get \"https://10.132.0.79:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:56.851943 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:44:56.818986    5039 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.189s"
Oct 31 07:44:56.851943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.819092    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:44:56.851943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.819179    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:44:56.851943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.819244    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:56.851943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.819295    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:44:56.851943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.819338    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:44:56.865330 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.865294    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:56.892143 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.891178    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main" probeResult="failure" output="Get \"https://10.132.0.72:8000/ready\": context deadline exceeded"
Oct 31 07:44:56.981113 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:56.981053    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:44:57.268643 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:57.268558    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:44:57.328330 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:57.328302    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:44:57.358114 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:57.358084    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:44:57.406487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:57.375739    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:44:57.425141 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:57.425113    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:44:57.509084 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:57.509056    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:44:58.699401 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:44:58.699360    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:44:58.706604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.706574    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-664rw-prslb"]
Oct 31 07:44:58.707338 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707315    5039 cpu_manager.go:414] "containerMap: removing container" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main"
Oct 31 07:44:58.707338 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707336    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707377    5039 cpu_manager.go:414] "containerMap: removing container" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707385    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707414    5039 cpu_manager.go:414] "containerMap: removing container" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707419    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707433    5039 cpu_manager.go:414] "containerMap: removing container" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707438    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707447    5039 cpu_manager.go:414] "containerMap: removing container" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707452    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707459    5039 cpu_manager.go:414] "containerMap: removing container" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707464    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy"
Oct 31 07:44:58.707479 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707480    5039 cpu_manager.go:414] "containerMap: removing container" podUID="b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" containerName="maas-api"
Oct 31 07:44:58.707804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707485    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" containerName="maas-api"
Oct 31 07:44:58.707804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707589    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="8a0edf1c-3207-446b-9dfa-ffd9525690bd" containerName="istio-proxy"
Oct 31 07:44:58.707804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707599    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="35afb827-a07f-46ee-9994-d893a25527ca" containerName="istio-proxy"
Oct 31 07:44:58.707804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707605    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="4a4c11ea-036c-4a3c-8d48-f484a49d152d" containerName="main"
Oct 31 07:44:58.707804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707611    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="6702c169-4f3d-4ae5-8477-6e0e3c8aff06" containerName="istio-proxy"
Oct 31 07:44:58.707804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707619    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7f1ec49-263c-46e5-bbb8-fd9d78d5651a" containerName="maas-api"
Oct 31 07:44:58.707804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707626    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="e6feac23-1388-43c2-97a1-6f208ea245df" containerName="main"
Oct 31 07:44:58.707804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.707636    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="0640587b-51a9-427b-b891-dd0ff80d1d23" containerName="main"
Oct 31 07:44:58.711367 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.711347    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.730860 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.730830    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-664rw-prslb"]
Oct 31 07:44:58.809677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.809639    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/bfe41bf6-ece6-425f-a0d4-04da4159aee9-archives-path\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.809677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.809674    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-trusted-ca-bundle\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.809955 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.809852    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-service-ca-bundle\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.810026 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.810005    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg48h\" (UniqueName: \"kubernetes.io/projected/bfe41bf6-ece6-425f-a0d4-04da4159aee9-kube-api-access-qg48h\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.911336 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.911288    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg48h\" (UniqueName: \"kubernetes.io/projected/bfe41bf6-ece6-425f-a0d4-04da4159aee9-kube-api-access-qg48h\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.911539 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.911432    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/bfe41bf6-ece6-425f-a0d4-04da4159aee9-archives-path\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.911539 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.911461    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-trusted-ca-bundle\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.911662 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.911602    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-service-ca-bundle\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.912051 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.912024    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/bfe41bf6-ece6-425f-a0d4-04da4159aee9-archives-path\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.912428 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.912404    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-service-ca-bundle\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.912843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.912824    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-trusted-ca-bundle\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:58.929500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:58.929472    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg48h\" (UniqueName: \"kubernetes.io/projected/bfe41bf6-ece6-425f-a0d4-04da4159aee9-kube-api-access-qg48h\") pod \"periodic-gathering-664rw-prslb\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") " pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:59.030991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:59.030950    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:44:59.346563 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:59.346536    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-664rw-prslb"]
Oct 31 07:44:59.349698 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:44:59.349669    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe41bf6_ece6_425f_a0d4_04da4159aee9.slice/crio-fe2734aecc13fcb8a3047ac253607007efce831f703dbe02a36e6698aea94a07 WatchSource:0}: Error finding container fe2734aecc13fcb8a3047ac253607007efce831f703dbe02a36e6698aea94a07: Status 404 returned error can't find the container with id fe2734aecc13fcb8a3047ac253607007efce831f703dbe02a36e6698aea94a07
Oct 31 07:44:59.689366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:59.689271    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:44:59.811159 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:59.807836    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-664rw-prslb" event={"ID":"bfe41bf6-ece6-425f-a0d4-04da4159aee9","Type":"ContainerStarted","Data":"93c8bf4f689755feb30b3b4526bf0e4b15ac6461b8ea42c9a35612b56b6ef141"}
Oct 31 07:44:59.811159 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:59.807904    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-664rw-prslb" event={"ID":"bfe41bf6-ece6-425f-a0d4-04da4159aee9","Type":"ContainerStarted","Data":"fe2734aecc13fcb8a3047ac253607007efce831f703dbe02a36e6698aea94a07"}
Oct 31 07:44:59.844341 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:44:59.844267    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-664rw-prslb" podStartSLOduration=1.8442463500000001 podStartE2EDuration="1.84424635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:44:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:44:59.843182367 +0000 UTC m=+1014.372377042" watchObservedRunningTime="2026-10-31 07:44:59.84424635 +0000 UTC m=+1014.373441029"
Oct 31 07:45:00.133601 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.133560    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"]
Oct 31 07:45:00.138723 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.138696    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"]
Oct 31 07:45:00.138907 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.138836    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:00.143391 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.143354    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"]
Oct 31 07:45:00.143495 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.143449    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:00.148221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.148200    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:00.158089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.157336    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"]
Oct 31 07:45:00.158089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.157345    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:45:00.163112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.163082    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"]
Oct 31 07:45:00.169773 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.169742    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"]
Oct 31 07:45:00.234636 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.234597    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-maas-api-service-ca\") pod \"maas-api-key-cleanup-29890545-jjm7v\" (UID: \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:00.234636 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.234641    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bdd918-5e8c-4701-b088-e29fce34b180-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw\" (UID: \"50bdd918-5e8c-4701-b088-e29fce34b180\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:00.234932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.234666    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7svfq\" (UniqueName: \"kubernetes.io/projected/50bdd918-5e8c-4701-b088-e29fce34b180-kube-api-access-7svfq\") pod \"maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw\" (UID: \"50bdd918-5e8c-4701-b088-e29fce34b180\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:00.234932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.234806    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzvbd\" (UniqueName: \"kubernetes.io/projected/5768b5e5-af88-42c7-8784-057cc0280a2b-kube-api-access-tzvbd\") pod \"maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm\" (UID: \"5768b5e5-af88-42c7-8784-057cc0280a2b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:00.235055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.234953    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5768b5e5-af88-42c7-8784-057cc0280a2b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm\" (UID: \"5768b5e5-af88-42c7-8784-057cc0280a2b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:00.235055 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.235000    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xmp4\" (UniqueName: \"kubernetes.io/projected/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-kube-api-access-6xmp4\") pod \"maas-api-key-cleanup-29890545-jjm7v\" (UID: \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:00.337103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.337057    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-maas-api-service-ca\") pod \"maas-api-key-cleanup-29890545-jjm7v\" (UID: \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:00.337103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.337105    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bdd918-5e8c-4701-b088-e29fce34b180-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw\" (UID: \"50bdd918-5e8c-4701-b088-e29fce34b180\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:00.337378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.337135    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7svfq\" (UniqueName: \"kubernetes.io/projected/50bdd918-5e8c-4701-b088-e29fce34b180-kube-api-access-7svfq\") pod \"maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw\" (UID: \"50bdd918-5e8c-4701-b088-e29fce34b180\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:00.337378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.337173    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzvbd\" (UniqueName: \"kubernetes.io/projected/5768b5e5-af88-42c7-8784-057cc0280a2b-kube-api-access-tzvbd\") pod \"maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm\" (UID: \"5768b5e5-af88-42c7-8784-057cc0280a2b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:00.337378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.337232    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5768b5e5-af88-42c7-8784-057cc0280a2b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm\" (UID: \"5768b5e5-af88-42c7-8784-057cc0280a2b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:00.337378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.337260    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xmp4\" (UniqueName: \"kubernetes.io/projected/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-kube-api-access-6xmp4\") pod \"maas-api-key-cleanup-29890545-jjm7v\" (UID: \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:00.337906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.337877    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5768b5e5-af88-42c7-8784-057cc0280a2b-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm\" (UID: \"5768b5e5-af88-42c7-8784-057cc0280a2b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:00.337906 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.337896    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-maas-api-service-ca\") pod \"maas-api-key-cleanup-29890545-jjm7v\" (UID: \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:00.338076 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.337884    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bdd918-5e8c-4701-b088-e29fce34b180-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw\" (UID: \"50bdd918-5e8c-4701-b088-e29fce34b180\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:00.355459 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.355430    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7svfq\" (UniqueName: \"kubernetes.io/projected/50bdd918-5e8c-4701-b088-e29fce34b180-kube-api-access-7svfq\") pod \"maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw\" (UID: \"50bdd918-5e8c-4701-b088-e29fce34b180\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:00.355678 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.355652    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xmp4\" (UniqueName: \"kubernetes.io/projected/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-kube-api-access-6xmp4\") pod \"maas-api-key-cleanup-29890545-jjm7v\" (UID: \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:00.355721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.355672    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzvbd\" (UniqueName: \"kubernetes.io/projected/5768b5e5-af88-42c7-8784-057cc0280a2b-kube-api-access-tzvbd\") pod \"maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm\" (UID: \"5768b5e5-af88-42c7-8784-057cc0280a2b\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:00.457529 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.457496    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:00.472990 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.472960    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:00.487379 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.487343    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:00.777266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.777229    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"]
Oct 31 07:45:00.779580 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:45:00.779550    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5768b5e5_af88_42c7_8784_057cc0280a2b.slice/crio-aade0728673b747dc3b149bc4f74c1bece774c2a43679a14bc522573e11c2027 WatchSource:0}: Error finding container aade0728673b747dc3b149bc4f74c1bece774c2a43679a14bc522573e11c2027: Status 404 returned error can't find the container with id aade0728673b747dc3b149bc4f74c1bece774c2a43679a14bc522573e11c2027
Oct 31 07:45:00.782179 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.782154    5039 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 07:45:00.810152 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.810117    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"]
Oct 31 07:45:00.811423 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:45:00.811389    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bdd918_5e8c_4701_b088_e29fce34b180.slice/crio-da867bbe90ddf61c23a381a0c746de27f9385c65f13f3396b164e7163f40272d WatchSource:0}: Error finding container da867bbe90ddf61c23a381a0c746de27f9385c65f13f3396b164e7163f40272d: Status 404 returned error can't find the container with id da867bbe90ddf61c23a381a0c746de27f9385c65f13f3396b164e7163f40272d
Oct 31 07:45:00.817682 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.817655    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"]
Oct 31 07:45:00.818797 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:45:00.818771    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4e33cdb_b0ab_4b0e_9ec0_1d97c83bd5da.slice/crio-69d087753f583086066e351a059504949328bf19051584c46da8e0923dea632d WatchSource:0}: Error finding container 69d087753f583086066e351a059504949328bf19051584c46da8e0923dea632d: Status 404 returned error can't find the container with id 69d087753f583086066e351a059504949328bf19051584c46da8e0923dea632d
Oct 31 07:45:00.819602 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:00.819572    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" event={"ID":"5768b5e5-af88-42c7-8784-057cc0280a2b","Type":"ContainerStarted","Data":"aade0728673b747dc3b149bc4f74c1bece774c2a43679a14bc522573e11c2027"}
Oct 31 07:45:01.009099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.009063    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"]
Oct 31 07:45:01.009436 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.009374    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7" podUID="7ac8622d-500c-4d62-92b2-4429096ffea6" containerName="maas-api" containerID="cri-o://0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329" gracePeriod=30
Oct 31 07:45:01.053739 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.053641    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:01.392215 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.392169    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"]
Oct 31 07:45:01.399111 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.398141    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.414120 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.412352    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:45:01.414120 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.413021    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"]
Oct 31 07:45:01.519392 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.519335    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"]
Oct 31 07:45:01.585569 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.585463    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dac3004d-6hnjv\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.585569 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.585551    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dac3004d-6hnjv\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.585800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.585628    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzhfk\" (UniqueName: \"kubernetes.io/projected/9060419f-e270-4c6c-9910-6402c53fb0db-kube-api-access-mzhfk\") pod \"maas-api-revoke-sub-dac3004d-6hnjv\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.684093 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.682550    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"]
Oct 31 07:45:01.718251 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.711876    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:01.725746 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.725676    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main" containerID="cri-o://4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4" gracePeriod=45
Oct 31 07:45:01.747590 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.747530    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main" containerID="cri-o://de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc" gracePeriod=45
Oct 31 07:45:01.751518 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.748022    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dac3004d-6hnjv\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.752898 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.752862    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-dac3004d-6hnjv\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.753020 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.752965    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzhfk\" (UniqueName: \"kubernetes.io/projected/9060419f-e270-4c6c-9910-6402c53fb0db-kube-api-access-mzhfk\") pod \"maas-api-revoke-sub-dac3004d-6hnjv\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.753714 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.753688    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dac3004d-6hnjv\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.756266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.755822    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:45:01.766058 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.766001    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-xks-ca\") pod \"maas-api-revoke-sub-dac3004d-6hnjv\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.784710 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.784627    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzhfk\" (UniqueName: \"kubernetes.io/projected/9060419f-e270-4c6c-9910-6402c53fb0db-kube-api-access-mzhfk\") pod \"maas-api-revoke-sub-dac3004d-6hnjv\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:01.855551 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.855507    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-metrics-certs\") pod \"7ac8622d-500c-4d62-92b2-4429096ffea6\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") "
Oct 31 07:45:01.856045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.855596    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" event={"ID":"50bdd918-5e8c-4701-b088-e29fce34b180","Type":"ContainerStarted","Data":"da867bbe90ddf61c23a381a0c746de27f9385c65f13f3396b164e7163f40272d"}
Oct 31 07:45:01.856045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.855709    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-maas-api-tls\") pod \"7ac8622d-500c-4d62-92b2-4429096ffea6\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") "
Oct 31 07:45:01.856045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.855745    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7ac8622d-500c-4d62-92b2-4429096ffea6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac8622d-500c-4d62-92b2-4429096ffea6-openshift-service-ca\") pod \"7ac8622d-500c-4d62-92b2-4429096ffea6\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") "
Oct 31 07:45:01.856045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.855934    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7ac8622d-500c-4d62-92b2-4429096ffea6-kube-api-access-vr8bn\" (UniqueName: \"kubernetes.io/projected/7ac8622d-500c-4d62-92b2-4429096ffea6-kube-api-access-vr8bn\") pod \"7ac8622d-500c-4d62-92b2-4429096ffea6\" (UID: \"7ac8622d-500c-4d62-92b2-4429096ffea6\") "
Oct 31 07:45:01.856604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.856572    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ac8622d-500c-4d62-92b2-4429096ffea6-openshift-service-ca" pod "7ac8622d-500c-4d62-92b2-4429096ffea6" (UID: "7ac8622d-500c-4d62-92b2-4429096ffea6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:01.858307 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.858275    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-maas-api-tls" pod "7ac8622d-500c-4d62-92b2-4429096ffea6" (UID: "7ac8622d-500c-4d62-92b2-4429096ffea6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:01.859428 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.859387    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ac8622d-500c-4d62-92b2-4429096ffea6-kube-api-access-vr8bn" pod "7ac8622d-500c-4d62-92b2-4429096ffea6" (UID: "7ac8622d-500c-4d62-92b2-4429096ffea6"). InnerVolumeSpecName "kube-api-access-vr8bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:01.860036 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.860014    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-metrics-certs" pod "7ac8622d-500c-4d62-92b2-4429096ffea6" (UID: "7ac8622d-500c-4d62-92b2-4429096ffea6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:01.861847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.861820    5039 generic.go:356] "Generic (PLEG): container finished" podID="7ac8622d-500c-4d62-92b2-4429096ffea6" containerID="0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329" exitCode=0
Oct 31 07:45:01.862085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.861880    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"
Oct 31 07:45:01.862163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.861908    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7" event={"ID":"7ac8622d-500c-4d62-92b2-4429096ffea6","Type":"ContainerDied","Data":"0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329"}
Oct 31 07:45:01.862299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.862202    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7" event={"ID":"7ac8622d-500c-4d62-92b2-4429096ffea6","Type":"ContainerDied","Data":"557e1c550557c5a6bedfb494f380e311331b0f4458075072348771e4b128bebe"}
Oct 31 07:45:01.862299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.862257    5039 scope.go:122] "RemoveContainer" containerID="0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329"
Oct 31 07:45:01.865197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.865164    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" event={"ID":"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da","Type":"ContainerStarted","Data":"69d087753f583086066e351a059504949328bf19051584c46da8e0923dea632d"}
Oct 31 07:45:01.904137 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.904020    5039 scope.go:122] "RemoveContainer" containerID="0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329"
Oct 31 07:45:01.904536 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:01.904493    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329\": container with ID starting with 0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329 not found: ID does not exist" containerID="0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329"
Oct 31 07:45:01.904668 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.904541    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329"} err="failed to get container status \"0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329\": rpc error: code = NotFound desc = could not find container \"0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329\": container with ID starting with 0854153cdddeeaecf5d05b356a72be5470dc1cccdb4e9709116c48927a03d329 not found: ID does not exist"
Oct 31 07:45:01.907244 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.907210    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:01.939613 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.939533    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"]
Oct 31 07:45:01.946824 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.946742    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-027d2a-59b44f6fc5-mwwg7"]
Oct 31 07:45:01.959048 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.958873    5039 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-metrics-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:01.959048 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.958953    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ac8622d-500c-4d62-92b2-4429096ffea6-maas-api-tls\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:01.959048 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.958974    5039 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ac8622d-500c-4d62-92b2-4429096ffea6-openshift-service-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:01.959048 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:01.958991    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vr8bn\" (UniqueName: \"kubernetes.io/projected/7ac8622d-500c-4d62-92b2-4429096ffea6-kube-api-access-vr8bn\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.042424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.042393    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:02.098994 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.097739    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:02.132208 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.131831    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:45:02.194732 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.194365    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:45:02.264346 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.264303    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-home\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-home\") pod \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") "
Oct 31 07:45:02.264587 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.264419    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-dshm\") pod \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") "
Oct 31 07:45:02.264587 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.264476    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-home\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-home\") pod \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") "
Oct 31 07:45:02.264587 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.264534    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-model-cache\") pod \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") "
Oct 31 07:45:02.264587 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.264568    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-dshm\") pod \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") "
Oct 31 07:45:02.264949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.264673    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf9f27cd-2223-42d0-9150-54a9a4e032cb-kube-api-access-45rnp\" (UniqueName: \"kubernetes.io/projected/cf9f27cd-2223-42d0-9150-54a9a4e032cb-kube-api-access-45rnp\") pod \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") "
Oct 31 07:45:02.264949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.264826    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tls-certs\" (UniqueName: \"kubernetes.io/secret/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tls-certs\") pod \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") "
Oct 31 07:45:02.264949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.264895    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tmp-dir\") pod \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") "
Oct 31 07:45:02.265175 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.264950    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-kube-api-access-85vl6\" (UniqueName: \"kubernetes.io/projected/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-kube-api-access-85vl6\") pod \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") "
Oct 31 07:45:02.265175 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.265016    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tls-certs\") pod \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") "
Oct 31 07:45:02.265175 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.265073    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tmp-dir\") pod \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\" (UID: \"cf9f27cd-2223-42d0-9150-54a9a4e032cb\") "
Oct 31 07:45:02.265175 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.265112    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-model-cache\") pod \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\" (UID: \"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1\") "
Oct 31 07:45:02.266156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.266119    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-model-cache" pod "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" (UID: "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:02.266438 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.266415    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-home" pod "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" (UID: "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:02.269555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.269493    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-dshm" pod "cf9f27cd-2223-42d0-9150-54a9a4e032cb" (UID: "cf9f27cd-2223-42d0-9150-54a9a4e032cb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:02.269753 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.269728    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-home" pod "cf9f27cd-2223-42d0-9150-54a9a4e032cb" (UID: "cf9f27cd-2223-42d0-9150-54a9a4e032cb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:02.269992 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.269968    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-model-cache" pod "cf9f27cd-2223-42d0-9150-54a9a4e032cb" (UID: "cf9f27cd-2223-42d0-9150-54a9a4e032cb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:02.277600 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.277423    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tmp-dir" pod "cf9f27cd-2223-42d0-9150-54a9a4e032cb" (UID: "cf9f27cd-2223-42d0-9150-54a9a4e032cb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:02.280685 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.279057    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tmp-dir" pod "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" (UID: "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:02.280685 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.280302    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-kube-api-access-85vl6" pod "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" (UID: "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1"). InnerVolumeSpecName "kube-api-access-85vl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:02.281577 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.281538    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-dshm" pod "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" (UID: "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:02.283716 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.283686    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9f27cd-2223-42d0-9150-54a9a4e032cb-kube-api-access-45rnp" pod "cf9f27cd-2223-42d0-9150-54a9a4e032cb" (UID: "cf9f27cd-2223-42d0-9150-54a9a4e032cb"). InnerVolumeSpecName "kube-api-access-45rnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:02.284382 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.284354    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tls-certs" pod "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" (UID: "fa0cd95f-2f11-4bab-b95e-60c0b22adbc1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:02.285189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.285164    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tls-certs" pod "cf9f27cd-2223-42d0-9150-54a9a4e032cb" (UID: "cf9f27cd-2223-42d0-9150-54a9a4e032cb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371088    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371128    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371142    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85vl6\" (UniqueName: \"kubernetes.io/projected/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-kube-api-access-85vl6\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371158    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371172    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371184    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371197    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371209    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371219    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371231    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf9f27cd-2223-42d0-9150-54a9a4e032cb-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371242    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.371333 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.371256    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45rnp\" (UniqueName: \"kubernetes.io/projected/cf9f27cd-2223-42d0-9150-54a9a4e032cb-kube-api-access-45rnp\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:02.459885 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.459697    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"]
Oct 31 07:45:02.465211 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:45:02.465173    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9060419f_e270_4c6c_9910_6402c53fb0db.slice/crio-d53ccbb4ed70da7ceea38ff17aae881c3f12ee42ed18c2e8169fd30d2d3d7812 WatchSource:0}: Error finding container d53ccbb4ed70da7ceea38ff17aae881c3f12ee42ed18c2e8169fd30d2d3d7812: Status 404 returned error can't find the container with id d53ccbb4ed70da7ceea38ff17aae881c3f12ee42ed18c2e8169fd30d2d3d7812
Oct 31 07:45:02.503397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.503358    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:02.710021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.706404    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:02.880794 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.880752    5039 generic.go:356] "Generic (PLEG): container finished" podID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerID="4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4" exitCode=0
Oct 31 07:45:02.881442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.880874    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" event={"ID":"cf9f27cd-2223-42d0-9150-54a9a4e032cb","Type":"ContainerDied","Data":"4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4"}
Oct 31 07:45:02.881442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.880938    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc" event={"ID":"cf9f27cd-2223-42d0-9150-54a9a4e032cb","Type":"ContainerDied","Data":"049e63a5f7fb68e1da28aad277dddd41e7eb4df53de2ad5572f59d5a6d012676"}
Oct 31 07:45:02.881442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.880963    5039 scope.go:122] "RemoveContainer" containerID="4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4"
Oct 31 07:45:02.881442 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.881075    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"
Oct 31 07:45:02.895896 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.895853    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv" event={"ID":"9060419f-e270-4c6c-9910-6402c53fb0db","Type":"ContainerStarted","Data":"d53ccbb4ed70da7ceea38ff17aae881c3f12ee42ed18c2e8169fd30d2d3d7812"}
Oct 31 07:45:02.919689 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.919651    5039 generic.go:356] "Generic (PLEG): container finished" podID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerID="de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc" exitCode=0
Oct 31 07:45:02.919871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.919704    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"
Oct 31 07:45:02.919871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.919727    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" event={"ID":"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1","Type":"ContainerDied","Data":"de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc"}
Oct 31 07:45:02.919871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.919761    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r" event={"ID":"fa0cd95f-2f11-4bab-b95e-60c0b22adbc1","Type":"ContainerDied","Data":"d2950cc467d027f32850e9548fcd4473621cd2c560786976bd43538cf0bd1776"}
Oct 31 07:45:02.927284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.926244    5039 scope.go:122] "RemoveContainer" containerID="4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4"
Oct 31 07:45:02.935347 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:02.933636    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4\": container with ID starting with 4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4 not found: ID does not exist" containerID="4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4"
Oct 31 07:45:02.935347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.933681    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4"} err="failed to get container status \"4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4\": rpc error: code = NotFound desc = could not find container \"4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4\": container with ID starting with 4839b6cfa5c498ac6b2b3e83fb06270d8ee7226224edc85ced82afb4519d62f4 not found: ID does not exist"
Oct 31 07:45:02.935347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.933709    5039 scope.go:122] "RemoveContainer" containerID="de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc"
Oct 31 07:45:02.953366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.953301    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"]
Oct 31 07:45:02.959646 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.959613    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-2-w5-b1fda4-kserve-cb569f4b5-ctwmc"]
Oct 31 07:45:02.975686 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.975557    5039 scope.go:122] "RemoveContainer" containerID="de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc"
Oct 31 07:45:02.984007 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:02.983159    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc\": container with ID starting with de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc not found: ID does not exist" containerID="de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc"
Oct 31 07:45:02.984007 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.983940    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc"} err="failed to get container status \"de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc\": rpc error: code = NotFound desc = could not find container \"de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc\": container with ID starting with de687032c2e5541eefa359d9fe4754d7492f1b21087858da37c56b6ea70816fc not found: ID does not exist"
Oct 31 07:45:02.990010 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.989963    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"]
Oct 31 07:45:02.994227 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:02.994202    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w5-b1fda4/distinct-w5-b1fda4-kserve-7f64797d58-xpq4r"]
Oct 31 07:45:03.625599 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:03.625561    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7ac8622d-500c-4d62-92b2-4429096ffea6" path="/var/lib/kubelet/pods/7ac8622d-500c-4d62-92b2-4429096ffea6/volumes"
Oct 31 07:45:03.626354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:03.626311    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" path="/var/lib/kubelet/pods/cf9f27cd-2223-42d0-9150-54a9a4e032cb/volumes"
Oct 31 07:45:03.626965 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:03.626934    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" path="/var/lib/kubelet/pods/fa0cd95f-2f11-4bab-b95e-60c0b22adbc1/volumes"
Oct 31 07:45:04.418143 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:04.418052    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:04.971965 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:04.971909    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:05.337030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:05.336897    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:05.538585 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:05.538526    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:06.102375 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:06.102339    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:07.014334 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:06.999479    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:07.038939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:07.035938    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" event={"ID":"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da","Type":"ContainerStarted","Data":"0f31f9de963575a7af2e7a688e0cffa04655a04007137f6487fc7c3b0a992aff"}
Oct 31 07:45:07.071295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:07.059950    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" event={"ID":"5768b5e5-af88-42c7-8784-057cc0280a2b","Type":"ContainerStarted","Data":"d55d830ca36a98489333ee354ea3e40d95aa7102e2d60ca3d0ef45ad164206d9"}
Oct 31 07:45:07.071295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:07.060420    5039 scope.go:122] "RemoveContainer" containerID="d55d830ca36a98489333ee354ea3e40d95aa7102e2d60ca3d0ef45ad164206d9"
Oct 31 07:45:07.100845 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:07.100453    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv" event={"ID":"9060419f-e270-4c6c-9910-6402c53fb0db","Type":"ContainerStarted","Data":"640d64b0fe4950ce98d377a2bcec69af38f1fe22db6016cfb20d5c27a0c34cd0"}
Oct 31 07:45:07.106058 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:07.106022    5039 scope.go:122] "RemoveContainer" containerID="42a471845afb0908de41d16a352f4c27688e9313d1d274da48cb16f42c011bd7"
Oct 31 07:45:07.111283 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:07.110993    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" event={"ID":"50bdd918-5e8c-4701-b088-e29fce34b180","Type":"ContainerStarted","Data":"42a471845afb0908de41d16a352f4c27688e9313d1d274da48cb16f42c011bd7"}
Oct 31 07:45:07.119968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:07.119869    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" podStartSLOduration=2.199630149 podStartE2EDuration="7.119847052s" totalImagesPullingTime="4.920216903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:07.117053279 +0000 UTC m=+1021.646247956" watchObservedRunningTime="2026-10-31 07:45:07.119847052 +0000 UTC m=+1021.649041727"
Oct 31 07:45:07.236950 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:07.236858    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv" podStartSLOduration=2.785160533 podStartE2EDuration="6.236836927s" totalImagesPullingTime="3.451676394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:07.229580632 +0000 UTC m=+1021.758775307" watchObservedRunningTime="2026-10-31 07:45:07.236836927 +0000 UTC m=+1021.766031602"
Oct 31 07:45:08.015213 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.015171    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:08.029583 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.029541    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"]
Oct 31 07:45:08.145907 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.145870    5039 generic.go:356] "Generic (PLEG): container finished" podID="50bdd918-5e8c-4701-b088-e29fce34b180" containerID="42a471845afb0908de41d16a352f4c27688e9313d1d274da48cb16f42c011bd7" exitCode=60
Oct 31 07:45:08.146126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.146105    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" event={"ID":"50bdd918-5e8c-4701-b088-e29fce34b180","Type":"ContainerDied","Data":"42a471845afb0908de41d16a352f4c27688e9313d1d274da48cb16f42c011bd7"}
Oct 31 07:45:08.146207 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.146165    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" event={"ID":"50bdd918-5e8c-4701-b088-e29fce34b180","Type":"ContainerStarted","Data":"9ecbcda0890730a9cd10dff038521ccf851c1678fafc7286de87ae0d67eda891"}
Oct 31 07:45:08.149040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.149009    5039 generic.go:356] "Generic (PLEG): container finished" podID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerID="0f31f9de963575a7af2e7a688e0cffa04655a04007137f6487fc7c3b0a992aff" exitCode=60
Oct 31 07:45:08.149184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.149092    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" event={"ID":"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da","Type":"ContainerDied","Data":"0f31f9de963575a7af2e7a688e0cffa04655a04007137f6487fc7c3b0a992aff"}
Oct 31 07:45:08.149402 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.149383    5039 scope.go:122] "RemoveContainer" containerID="0f31f9de963575a7af2e7a688e0cffa04655a04007137f6487fc7c3b0a992aff"
Oct 31 07:45:08.156351 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.156327    5039 generic.go:356] "Generic (PLEG): container finished" podID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerID="d55d830ca36a98489333ee354ea3e40d95aa7102e2d60ca3d0ef45ad164206d9" exitCode=60
Oct 31 07:45:08.156464 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.156439    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" event={"ID":"5768b5e5-af88-42c7-8784-057cc0280a2b","Type":"ContainerDied","Data":"d55d830ca36a98489333ee354ea3e40d95aa7102e2d60ca3d0ef45ad164206d9"}
Oct 31 07:45:08.156538 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.156520    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" event={"ID":"5768b5e5-af88-42c7-8784-057cc0280a2b","Type":"ContainerStarted","Data":"5ca7ef4bb0c40312c4d34a30110b84d2d0b989497d25141f553fd3127ece8332"}
Oct 31 07:45:08.166014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.165989    5039 generic.go:356] "Generic (PLEG): container finished" podID="9060419f-e270-4c6c-9910-6402c53fb0db" containerID="640d64b0fe4950ce98d377a2bcec69af38f1fe22db6016cfb20d5c27a0c34cd0" exitCode=0
Oct 31 07:45:08.166133 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.166068    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv" event={"ID":"9060419f-e270-4c6c-9910-6402c53fb0db","Type":"ContainerDied","Data":"640d64b0fe4950ce98d377a2bcec69af38f1fe22db6016cfb20d5c27a0c34cd0"}
Oct 31 07:45:08.189065 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.189018    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" podStartSLOduration=3.255732216 podStartE2EDuration="8.189003583s" totalImagesPullingTime="4.933271367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:08.185682466 +0000 UTC m=+1022.714877140" watchObservedRunningTime="2026-10-31 07:45:08.189003583 +0000 UTC m=+1022.718198257"
Oct 31 07:45:08.205573 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.205546    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:08.297270 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:08.297217    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" podStartSLOduration=3.275535102 podStartE2EDuration="8.297201575s" totalImagesPullingTime="5.021666473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:08.296472431 +0000 UTC m=+1022.825667099" watchObservedRunningTime="2026-10-31 07:45:08.297201575 +0000 UTC m=+1022.826396249"
Oct 31 07:45:09.010043 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.010005    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:09.177358 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.177318    5039 generic.go:356] "Generic (PLEG): container finished" podID="50bdd918-5e8c-4701-b088-e29fce34b180" containerID="9ecbcda0890730a9cd10dff038521ccf851c1678fafc7286de87ae0d67eda891" exitCode=60
Oct 31 07:45:09.177358 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.177353    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" event={"ID":"50bdd918-5e8c-4701-b088-e29fce34b180","Type":"ContainerDied","Data":"9ecbcda0890730a9cd10dff038521ccf851c1678fafc7286de87ae0d67eda891"}
Oct 31 07:45:09.177877 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.177417    5039 scope.go:122] "RemoveContainer" containerID="42a471845afb0908de41d16a352f4c27688e9313d1d274da48cb16f42c011bd7"
Oct 31 07:45:09.177877 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.177763    5039 scope.go:122] "RemoveContainer" containerID="9ecbcda0890730a9cd10dff038521ccf851c1678fafc7286de87ae0d67eda891"
Oct 31 07:45:09.178222 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:09.178188    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw_odh-ai-gateway-infra(50bdd918-5e8c-4701-b088-e29fce34b180)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" podUID="50bdd918-5e8c-4701-b088-e29fce34b180"
Oct 31 07:45:09.179877 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.179856    5039 generic.go:356] "Generic (PLEG): container finished" podID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerID="ef09f2257ea4610485bacc3a6b9e89ec177dea10c08f6492d14cdbc98ff9fbba" exitCode=60
Oct 31 07:45:09.180031 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.179887    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" event={"ID":"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da","Type":"ContainerDied","Data":"ef09f2257ea4610485bacc3a6b9e89ec177dea10c08f6492d14cdbc98ff9fbba"}
Oct 31 07:45:09.180286 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.180271    5039 scope.go:122] "RemoveContainer" containerID="ef09f2257ea4610485bacc3a6b9e89ec177dea10c08f6492d14cdbc98ff9fbba"
Oct 31 07:45:09.180695 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:09.180674    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29890545-jjm7v_odh-ai-gateway-infra(f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da"
Oct 31 07:45:09.182057 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.182032    5039 generic.go:356] "Generic (PLEG): container finished" podID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerID="5ca7ef4bb0c40312c4d34a30110b84d2d0b989497d25141f553fd3127ece8332" exitCode=60
Oct 31 07:45:09.182204 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.182171    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" event={"ID":"5768b5e5-af88-42c7-8784-057cc0280a2b","Type":"ContainerDied","Data":"5ca7ef4bb0c40312c4d34a30110b84d2d0b989497d25141f553fd3127ece8332"}
Oct 31 07:45:09.182400 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.182379    5039 scope.go:122] "RemoveContainer" containerID="5ca7ef4bb0c40312c4d34a30110b84d2d0b989497d25141f553fd3127ece8332"
Oct 31 07:45:09.182732 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:09.182712    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm_odh-ai-gateway-infra(5768b5e5-af88-42c7-8784-057cc0280a2b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b"
Oct 31 07:45:09.202516 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.202484    5039 scope.go:122] "RemoveContainer" containerID="0f31f9de963575a7af2e7a688e0cffa04655a04007137f6487fc7c3b0a992aff"
Oct 31 07:45:09.221329 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.221291    5039 scope.go:122] "RemoveContainer" containerID="d55d830ca36a98489333ee354ea3e40d95aa7102e2d60ca3d0ef45ad164206d9"
Oct 31 07:45:09.225456 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.225431    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:09.379750 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.376452    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"]
Oct 31 07:45:09.379750 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.376706    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy" containerID="cri-o://377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5" gracePeriod=30
Oct 31 07:45:09.384116 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.384081    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"]
Oct 31 07:45:09.384754 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.384334    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy" containerID="cri-o://d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007" gracePeriod=30
Oct 31 07:45:09.422658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.422627    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:09.426286 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.426256    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:09.529570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.529534    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-xks-ca\") pod \"9060419f-e270-4c6c-9910-6402c53fb0db\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") "
Oct 31 07:45:09.534051 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.534017    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9060419f-e270-4c6c-9910-6402c53fb0db-kube-api-access-mzhfk\" (UniqueName: \"kubernetes.io/projected/9060419f-e270-4c6c-9910-6402c53fb0db-kube-api-access-mzhfk\") pod \"9060419f-e270-4c6c-9910-6402c53fb0db\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") "
Oct 31 07:45:09.548671 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.548637    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-openshift-ca\") pod \"9060419f-e270-4c6c-9910-6402c53fb0db\" (UID: \"9060419f-e270-4c6c-9910-6402c53fb0db\") "
Oct 31 07:45:09.550842 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.550805    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-openshift-ca" pod "9060419f-e270-4c6c-9910-6402c53fb0db" (UID: "9060419f-e270-4c6c-9910-6402c53fb0db"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:09.556242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.556204    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9060419f-e270-4c6c-9910-6402c53fb0db-kube-api-access-mzhfk" pod "9060419f-e270-4c6c-9910-6402c53fb0db" (UID: "9060419f-e270-4c6c-9910-6402c53fb0db"). InnerVolumeSpecName "kube-api-access-mzhfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:09.556582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.556560    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-xks-ca" pod "9060419f-e270-4c6c-9910-6402c53fb0db" (UID: "9060419f-e270-4c6c-9910-6402c53fb0db"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:09.653699 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.653666    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:09.653699 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.653696    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9060419f-e270-4c6c-9910-6402c53fb0db-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:09.653699 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:09.653706    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzhfk\" (UniqueName: \"kubernetes.io/projected/9060419f-e270-4c6c-9910-6402c53fb0db-kube-api-access-mzhfk\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:10.120123 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:10.120083    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:10.195294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:10.195263    5039 scope.go:122] "RemoveContainer" containerID="9ecbcda0890730a9cd10dff038521ccf851c1678fafc7286de87ae0d67eda891"
Oct 31 07:45:10.201665 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:10.201623    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw_odh-ai-gateway-infra(50bdd918-5e8c-4701-b088-e29fce34b180)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" podUID="50bdd918-5e8c-4701-b088-e29fce34b180"
Oct 31 07:45:10.203072 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:10.203044    5039 scope.go:122] "RemoveContainer" containerID="ef09f2257ea4610485bacc3a6b9e89ec177dea10c08f6492d14cdbc98ff9fbba"
Oct 31 07:45:10.203435 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:10.203409    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29890545-jjm7v_odh-ai-gateway-infra(f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da"
Oct 31 07:45:10.205629 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:10.205609    5039 scope.go:122] "RemoveContainer" containerID="5ca7ef4bb0c40312c4d34a30110b84d2d0b989497d25141f553fd3127ece8332"
Oct 31 07:45:10.205972 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:10.205943    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm_odh-ai-gateway-infra(5768b5e5-af88-42c7-8784-057cc0280a2b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b"
Oct 31 07:45:10.207049 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:10.207022    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv" event={"ID":"9060419f-e270-4c6c-9910-6402c53fb0db","Type":"ContainerDied","Data":"d53ccbb4ed70da7ceea38ff17aae881c3f12ee42ed18c2e8169fd30d2d3d7812"}
Oct 31 07:45:10.207146 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:10.207071    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"
Oct 31 07:45:10.207146 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:10.207117    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d53ccbb4ed70da7ceea38ff17aae881c3f12ee42ed18c2e8169fd30d2d3d7812"
Oct 31 07:45:11.069077 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.069042    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:11.309196 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309161    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"]
Oct 31 07:45:11.309787 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309773    5039 cpu_manager.go:414] "containerMap: removing container" podUID="7ac8622d-500c-4d62-92b2-4429096ffea6" containerName="maas-api"
Oct 31 07:45:11.309836 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309788    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7ac8622d-500c-4d62-92b2-4429096ffea6" containerName="maas-api"
Oct 31 07:45:11.309836 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309799    5039 cpu_manager.go:414] "containerMap: removing container" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main"
Oct 31 07:45:11.309836 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309804    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main"
Oct 31 07:45:11.309836 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309814    5039 cpu_manager.go:414] "containerMap: removing container" podUID="9060419f-e270-4c6c-9910-6402c53fb0db" containerName="revoke-keys"
Oct 31 07:45:11.309836 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309819    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9060419f-e270-4c6c-9910-6402c53fb0db" containerName="revoke-keys"
Oct 31 07:45:11.309836 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309835    5039 cpu_manager.go:414] "containerMap: removing container" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main"
Oct 31 07:45:11.310117 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309839    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main"
Oct 31 07:45:11.310117 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309961    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="9060419f-e270-4c6c-9910-6402c53fb0db" containerName="revoke-keys"
Oct 31 07:45:11.310117 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309976    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="fa0cd95f-2f11-4bab-b95e-60c0b22adbc1" containerName="main"
Oct 31 07:45:11.310117 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309989    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="7ac8622d-500c-4d62-92b2-4429096ffea6" containerName="maas-api"
Oct 31 07:45:11.310117 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.309995    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf9f27cd-2223-42d0-9150-54a9a4e032cb" containerName="main"
Oct 31 07:45:11.313721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.313702    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.329932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.329859    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:45:11.336899 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.336866    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"]
Oct 31 07:45:11.480301 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.480263    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.480480 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.480403    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vwt7\" (UniqueName: \"kubernetes.io/projected/0db205e5-99fe-4bb0-9957-43514551830f-kube-api-access-9vwt7\") pod \"maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.480543 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.480483    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.538877 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.538838    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:11.581519 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.581438    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.581663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.581561    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vwt7\" (UniqueName: \"kubernetes.io/projected/0db205e5-99fe-4bb0-9957-43514551830f-kube-api-access-9vwt7\") pod \"maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.581727 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.581670    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.582218 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.582190    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.584172 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.584150    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.599278 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.599252    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vwt7\" (UniqueName: \"kubernetes.io/projected/0db205e5-99fe-4bb0-9957-43514551830f-kube-api-access-9vwt7\") pod \"maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.628315 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.628284    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:11.677373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.677334    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 07:45:11.677533 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.677394    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:45:11.956044 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.956013    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"]
Oct 31 07:45:11.976582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:11.976558    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:12.224350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:12.224313    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82" event={"ID":"0db205e5-99fe-4bb0-9957-43514551830f","Type":"ContainerStarted","Data":"741c30b9a32130deb94796d7043eb6c22705948ec2cb75e94e9a02502ae40d35"}
Oct 31 07:45:12.720362 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:12.720324    5039 patch_prober.go:29] interesting pod/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 07:45:12.720765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:12.720383    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:45:13.030491 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:13.030444    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b" podUID="9ec6f58c-cc28-4dd8-b87f-03085f51a69c" containerName="payload-pre-processing" containerID="cri-o://d9c51860abe82c7ba7225d9f2bf05c87c9b6a9f73d366a6424e9a6bfa97498ca" gracePeriod=25
Oct 31 07:45:13.233279 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:13.233193    5039 generic.go:356] "Generic (PLEG): container finished" podID="0db205e5-99fe-4bb0-9957-43514551830f" containerID="45806b4ff901ac6122cf85d330356f217530653285e9771f5570fcc32091de99" exitCode=0
Oct 31 07:45:13.233451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:13.233278    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82" event={"ID":"0db205e5-99fe-4bb0-9957-43514551830f","Type":"ContainerDied","Data":"45806b4ff901ac6122cf85d330356f217530653285e9771f5570fcc32091de99"}
Oct 31 07:45:13.635822 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:13.635718    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:14.541089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.540716    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:14.683310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.683276    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:45:14.704042 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.704016    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:45:14.724826 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.724786    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-openshift-ca\") pod \"0db205e5-99fe-4bb0-9957-43514551830f\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") "
Oct 31 07:45:14.725112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.725051    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-xks-ca\") pod \"0db205e5-99fe-4bb0-9957-43514551830f\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") "
Oct 31 07:45:14.725274 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.725230    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0db205e5-99fe-4bb0-9957-43514551830f-kube-api-access-9vwt7\" (UniqueName: \"kubernetes.io/projected/0db205e5-99fe-4bb0-9957-43514551830f-kube-api-access-9vwt7\") pod \"0db205e5-99fe-4bb0-9957-43514551830f\" (UID: \"0db205e5-99fe-4bb0-9957-43514551830f\") "
Oct 31 07:45:14.725730 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.725701    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-openshift-ca" pod "0db205e5-99fe-4bb0-9957-43514551830f" (UID: "0db205e5-99fe-4bb0-9957-43514551830f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:14.725971 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.725950    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.727998 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.727971    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0db205e5-99fe-4bb0-9957-43514551830f-kube-api-access-9vwt7" pod "0db205e5-99fe-4bb0-9957-43514551830f" (UID: "0db205e5-99fe-4bb0-9957-43514551830f"). InnerVolumeSpecName "kube-api-access-9vwt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:14.728487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.728466    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-xks-ca" pod "0db205e5-99fe-4bb0-9957-43514551830f" (UID: "0db205e5-99fe-4bb0-9957-43514551830f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:14.827177 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827080    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istiod-ca-cert\") pod \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") "
Oct 31 07:45:14.827177 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827144    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-kube-api-access-tszc9\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-kube-api-access-tszc9\") pod \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") "
Oct 31 07:45:14.827418 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827182    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-certs\") pod \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") "
Oct 31 07:45:14.827418 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827218    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-credential-socket\") pod \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") "
Oct 31 07:45:14.827418 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827294    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-socket\") pod \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") "
Oct 31 07:45:14.827418 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827341    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-socket\") pod \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") "
Oct 31 07:45:14.827418 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827388    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istiod-ca-cert\") pod \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") "
Oct 31 07:45:14.827677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827454    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-podinfo\") pod \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") "
Oct 31 07:45:14.827677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827463    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-certs" pod "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" (UID: "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.827677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827498    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-podinfo\") pod \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") "
Oct 31 07:45:14.827677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827592    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-certs\") pod \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") "
Oct 31 07:45:14.827677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827622    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-socket" pod "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" (UID: "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.827677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827633    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-credential-socket\") pod \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") "
Oct 31 07:45:14.828009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827717    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-envoy\") pod \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") "
Oct 31 07:45:14.828009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827813    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-envoy\") pod \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") "
Oct 31 07:45:14.828009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827907    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-data\") pod \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") "
Oct 31 07:45:14.828009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827961    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-kube-api-access-qm8hc\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-kube-api-access-qm8hc\") pod \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") "
Oct 31 07:45:14.828189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.828055    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-token\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-token\") pod \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\" (UID: \"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df\") "
Oct 31 07:45:14.828189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.828085    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-token\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-token\") pod \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") "
Oct 31 07:45:14.828189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827544    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istiod-ca-cert" pod "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" (UID: "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:14.828189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827889    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-credential-socket" pod "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" (UID: "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.828189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.827945    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-socket" pod "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" (UID: "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.828189 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.828108    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-certs" pod "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" (UID: "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.828488 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.828186    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istiod-ca-cert" pod "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" (UID: "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:14.828547 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.828480    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-credential-socket" pod "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" (UID: "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.828596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.828566    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-data\") pod \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\" (UID: \"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7\") "
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829518    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829546    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829563    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/0db205e5-99fe-4bb0-9957-43514551830f-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829580    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vwt7\" (UniqueName: \"kubernetes.io/projected/0db205e5-99fe-4bb0-9957-43514551830f-kube-api-access-9vwt7\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829594    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829611    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829626    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829642    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829657    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.829672    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.830023    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-data" pod "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" (UID: "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.830300 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.830249    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-data" pod "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" (UID: "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.831318 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.831241    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-envoy" pod "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" (UID: "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.831449 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.831339    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-podinfo" pod "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" (UID: "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:14.831449 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.831386    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-kube-api-access-qm8hc" pod "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" (UID: "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df"). InnerVolumeSpecName "kube-api-access-qm8hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:14.831582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.831496    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-podinfo" pod "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" (UID: "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:14.831646 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.831609    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-kube-api-access-tszc9" pod "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" (UID: "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7"). InnerVolumeSpecName "kube-api-access-tszc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:14.832194 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.832166    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-token" pod "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" (UID: "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:14.833454 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.833421    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-envoy" pod "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" (UID: "0fbb78a6-fb23-4504-9171-f3f9b9a2a2df"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:14.834859 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.834833    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-token" pod "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" (UID: "b6a5f920-9bf3-4ca2-869d-26de1d9c66f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:14.931163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931115    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tszc9\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-kube-api-access-tszc9\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.931163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931161    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.931364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931176    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.931364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931189    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.931364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931202    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.931364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931214    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.931364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931227    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm8hc\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-kube-api-access-qm8hc\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.931364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931241    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.931364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931253    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:14.931364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:14.931265    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:15.114313 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114223    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"]
Oct 31 07:45:15.114807 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114794    5039 cpu_manager.go:414] "containerMap: removing container" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy"
Oct 31 07:45:15.114850 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114807    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy"
Oct 31 07:45:15.114850 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114833    5039 cpu_manager.go:414] "containerMap: removing container" podUID="0db205e5-99fe-4bb0-9957-43514551830f" containerName="revoke-keys"
Oct 31 07:45:15.114850 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114838    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0db205e5-99fe-4bb0-9957-43514551830f" containerName="revoke-keys"
Oct 31 07:45:15.114962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114865    5039 cpu_manager.go:414] "containerMap: removing container" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy"
Oct 31 07:45:15.114962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114871    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy"
Oct 31 07:45:15.115021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114974    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="0db205e5-99fe-4bb0-9957-43514551830f" containerName="revoke-keys"
Oct 31 07:45:15.115021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114989    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerName="istio-proxy"
Oct 31 07:45:15.115021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.114997    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerName="istio-proxy"
Oct 31 07:45:15.119667 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.119640    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.138848 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.138801    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"]
Oct 31 07:45:15.235198 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.235157    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fb31e973-44vn2\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.235198 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.235202    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g579r\" (UniqueName: \"kubernetes.io/projected/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-kube-api-access-g579r\") pod \"maas-api-revoke-sub-fb31e973-44vn2\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.235454 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.235327    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fb31e973-44vn2\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.249658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.249628    5039 generic.go:356] "Generic (PLEG): container finished" podID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" containerID="377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5" exitCode=0
Oct 31 07:45:15.249816 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.249678    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"
Oct 31 07:45:15.249816 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.249720    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" event={"ID":"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df","Type":"ContainerDied","Data":"377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5"}
Oct 31 07:45:15.249816 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.249774    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf" event={"ID":"0fbb78a6-fb23-4504-9171-f3f9b9a2a2df","Type":"ContainerDied","Data":"a5496b5c9fef6d606d5caf4a843079bab80d9c89570f117f2ae4fb8d5bf13646"}
Oct 31 07:45:15.249816 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.249797    5039 scope.go:122] "RemoveContainer" containerID="377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5"
Oct 31 07:45:15.251523 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.251501    5039 generic.go:356] "Generic (PLEG): container finished" podID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" containerID="d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007" exitCode=0
Oct 31 07:45:15.251618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.251543    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"
Oct 31 07:45:15.251618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.251596    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" event={"ID":"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7","Type":"ContainerDied","Data":"d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007"}
Oct 31 07:45:15.251731 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.251668    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l" event={"ID":"b6a5f920-9bf3-4ca2-869d-26de1d9c66f7","Type":"ContainerDied","Data":"0feb4db91a1a5e9b77efe2f5cc5ea7d2d42a70570b1f7e0e5936249ba9241e89"}
Oct 31 07:45:15.253304 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.253273    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82" event={"ID":"0db205e5-99fe-4bb0-9957-43514551830f","Type":"ContainerDied","Data":"741c30b9a32130deb94796d7043eb6c22705948ec2cb75e94e9a02502ae40d35"}
Oct 31 07:45:15.253304 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.253293    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"
Oct 31 07:45:15.253459 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.253314    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="741c30b9a32130deb94796d7043eb6c22705948ec2cb75e94e9a02502ae40d35"
Oct 31 07:45:15.263244 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.263218    5039 scope.go:122] "RemoveContainer" containerID="377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5"
Oct 31 07:45:15.263633 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:15.263590    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5\": container with ID starting with 377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5 not found: ID does not exist" containerID="377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5"
Oct 31 07:45:15.263699 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.263627    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5"} err="failed to get container status \"377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5\": rpc error: code = NotFound desc = could not find container \"377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5\": container with ID starting with 377bd081bbd751efcfe28ebe87c35ca1e03fb6122529311e56085ea7546ed6c5 not found: ID does not exist"
Oct 31 07:45:15.263699 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.263651    5039 scope.go:122] "RemoveContainer" containerID="d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007"
Oct 31 07:45:15.273721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.273697    5039 scope.go:122] "RemoveContainer" containerID="d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007"
Oct 31 07:45:15.274059 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:15.274037    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007\": container with ID starting with d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007 not found: ID does not exist" containerID="d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007"
Oct 31 07:45:15.274133 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.274070    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007"} err="failed to get container status \"d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007\": rpc error: code = NotFound desc = could not find container \"d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007\": container with ID starting with d703b41a69dcf67100811d5756f78d020a82ce18c8e947620e5f83808a9ba007 not found: ID does not exist"
Oct 31 07:45:15.338958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.330683    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"]
Oct 31 07:45:15.340005 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.339972    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fb31e973-44vn2\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.340156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.340014    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g579r\" (UniqueName: \"kubernetes.io/projected/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-kube-api-access-g579r\") pod \"maas-api-revoke-sub-fb31e973-44vn2\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.340156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.340078    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fb31e973-44vn2\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.340719 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.340692    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-fb31e973-44vn2\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.342566 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.342542    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-xks-ca\") pod \"maas-api-revoke-sub-fb31e973-44vn2\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.344984 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.344960    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-xxrwf"]
Oct 31 07:45:15.357686 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.357651    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g579r\" (UniqueName: \"kubernetes.io/projected/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-kube-api-access-g579r\") pod \"maas-api-revoke-sub-fb31e973-44vn2\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.374985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.374883    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"]
Oct 31 07:45:15.379673 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.379646    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-027d2a-openshift-default-849f6d6869-55s2l"]
Oct 31 07:45:15.441595 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.441560    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:15.485775 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.485746    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:15.623491 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.623459    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0fbb78a6-fb23-4504-9171-f3f9b9a2a2df" path="/var/lib/kubelet/pods/0fbb78a6-fb23-4504-9171-f3f9b9a2a2df/volumes"
Oct 31 07:45:15.624075 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.624058    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b6a5f920-9bf3-4ca2-869d-26de1d9c66f7" path="/var/lib/kubelet/pods/b6a5f920-9bf3-4ca2-869d-26de1d9c66f7/volumes"
Oct 31 07:45:15.746871 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:15.746841    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"]
Oct 31 07:45:15.749671 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:45:15.749643    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d2ec944_1203_4c38_8f6c_fdb5c0646d56.slice/crio-8fc875d00ac12945ca5a9b73fca6bd8e16b4f3af438041b10b475831c4d18f77 WatchSource:0}: Error finding container 8fc875d00ac12945ca5a9b73fca6bd8e16b4f3af438041b10b475831c4d18f77: Status 404 returned error can't find the container with id 8fc875d00ac12945ca5a9b73fca6bd8e16b4f3af438041b10b475831c4d18f77
Oct 31 07:45:16.066450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.066417    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"]
Oct 31 07:45:16.142623 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.142587    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:16.263882 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.263840    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2" event={"ID":"6d2ec944-1203-4c38-8f6c-fdb5c0646d56","Type":"ContainerStarted","Data":"e1011f885a2bc3f0cfcfd44c9b31d276cc3ef8512478a1a5a3c97cfe5df569dd"}
Oct 31 07:45:16.264079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.263896    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2" event={"ID":"6d2ec944-1203-4c38-8f6c-fdb5c0646d56","Type":"ContainerStarted","Data":"8fc875d00ac12945ca5a9b73fca6bd8e16b4f3af438041b10b475831c4d18f77"}
Oct 31 07:45:16.301342 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.301278    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2" podStartSLOduration=1.301259841 podStartE2EDuration="1.301259841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:16.298450515 +0000 UTC m=+1030.827645185" watchObservedRunningTime="2026-10-31 07:45:16.301259841 +0000 UTC m=+1030.830454516"
Oct 31 07:45:16.597037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.596992    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main" containerID="cri-o://e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc" gracePeriod=45
Oct 31 07:45:16.738767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.738713    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main" containerID="cri-o://fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63" gracePeriod=45
Oct 31 07:45:16.897181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.897144    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:45:16.964451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.964409    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-home\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-home\") pod \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") "
Oct 31 07:45:16.964626 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.964489    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tmp-dir\") pod \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") "
Oct 31 07:45:16.964626 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.964532    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-kube-api-access-9tzz9\" (UniqueName: \"kubernetes.io/projected/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-kube-api-access-9tzz9\") pod \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") "
Oct 31 07:45:16.964757 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.964627    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tls-certs\" (UniqueName: \"kubernetes.io/secret/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tls-certs\") pod \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") "
Oct 31 07:45:16.964757 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.964716    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-model-cache\") pod \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") "
Oct 31 07:45:16.964881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.964764    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-dshm\") pod \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\" (UID: \"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc\") "
Oct 31 07:45:16.965812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.965281    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tmp-dir" pod "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" (UID: "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:16.965812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.965694    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-model-cache" pod "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" (UID: "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:16.965812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.965763    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:16.966264 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.966179    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-home" pod "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" (UID: "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:16.968310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.968285    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-kube-api-access-9tzz9" pod "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" (UID: "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc"). InnerVolumeSpecName "kube-api-access-9tzz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:16.986761 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.986343    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tls-certs" pod "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" (UID: "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:16.989421 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:16.989379    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-dshm" pod "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" (UID: "9788c2a9-b8cf-48ec-8c2d-128b0e9289fc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:17.035509 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.035482    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:45:17.066772 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.066737    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-model-cache\") pod \"18a15066-1fa5-40bc-94c5-3252031312c8\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") "
Oct 31 07:45:17.066996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.066803    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-dshm\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-dshm\") pod \"18a15066-1fa5-40bc-94c5-3252031312c8\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") "
Oct 31 07:45:17.066996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.066865    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-tmp-dir\") pod \"18a15066-1fa5-40bc-94c5-3252031312c8\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") "
Oct 31 07:45:17.067122 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067055    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-model-cache" pod "18a15066-1fa5-40bc-94c5-3252031312c8" (UID: "18a15066-1fa5-40bc-94c5-3252031312c8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:17.067122 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067105    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-tmp-dir" pod "18a15066-1fa5-40bc-94c5-3252031312c8" (UID: "18a15066-1fa5-40bc-94c5-3252031312c8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:17.067216 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067141    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/18a15066-1fa5-40bc-94c5-3252031312c8-tls-certs\" (UniqueName: \"kubernetes.io/secret/18a15066-1fa5-40bc-94c5-3252031312c8-tls-certs\") pod \"18a15066-1fa5-40bc-94c5-3252031312c8\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") "
Oct 31 07:45:17.067271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067230    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-home\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-home\") pod \"18a15066-1fa5-40bc-94c5-3252031312c8\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") "
Oct 31 07:45:17.067337 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067266    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/18a15066-1fa5-40bc-94c5-3252031312c8-kube-api-access-g8wxg\" (UniqueName: \"kubernetes.io/projected/18a15066-1fa5-40bc-94c5-3252031312c8-kube-api-access-g8wxg\") pod \"18a15066-1fa5-40bc-94c5-3252031312c8\" (UID: \"18a15066-1fa5-40bc-94c5-3252031312c8\") "
Oct 31 07:45:17.067496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067441    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-home" pod "18a15066-1fa5-40bc-94c5-3252031312c8" (UID: "18a15066-1fa5-40bc-94c5-3252031312c8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:17.067827 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067807    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.067883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067833    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tzz9\" (UniqueName: \"kubernetes.io/projected/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-kube-api-access-9tzz9\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.067883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067853    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.067883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067867    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.067883 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067880    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.068030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067894    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.068030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067907    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.068030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.067934    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.068967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.068945    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-dshm" pod "18a15066-1fa5-40bc-94c5-3252031312c8" (UID: "18a15066-1fa5-40bc-94c5-3252031312c8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:17.069237 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.069214    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18a15066-1fa5-40bc-94c5-3252031312c8-tls-certs" pod "18a15066-1fa5-40bc-94c5-3252031312c8" (UID: "18a15066-1fa5-40bc-94c5-3252031312c8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:17.069388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.069372    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18a15066-1fa5-40bc-94c5-3252031312c8-kube-api-access-g8wxg" pod "18a15066-1fa5-40bc-94c5-3252031312c8" (UID: "18a15066-1fa5-40bc-94c5-3252031312c8"). InnerVolumeSpecName "kube-api-access-g8wxg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:17.140810 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.140711    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:17.168878 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.168849    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18a15066-1fa5-40bc-94c5-3252031312c8-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.168878 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.168877    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8wxg\" (UniqueName: \"kubernetes.io/projected/18a15066-1fa5-40bc-94c5-3252031312c8-kube-api-access-g8wxg\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.168878 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.168888    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18a15066-1fa5-40bc-94c5-3252031312c8-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:17.277474 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.277426    5039 generic.go:356] "Generic (PLEG): container finished" podID="18a15066-1fa5-40bc-94c5-3252031312c8" containerID="fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63" exitCode=0
Oct 31 07:45:17.277474 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.277476    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"
Oct 31 07:45:17.277812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.277500    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" event={"ID":"18a15066-1fa5-40bc-94c5-3252031312c8","Type":"ContainerDied","Data":"fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63"}
Oct 31 07:45:17.277812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.277556    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x" event={"ID":"18a15066-1fa5-40bc-94c5-3252031312c8","Type":"ContainerDied","Data":"382e662564de620b703300853e2dfcac165e2b7f1c07c34d5ba05091492c078d"}
Oct 31 07:45:17.277812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.277580    5039 scope.go:122] "RemoveContainer" containerID="fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63"
Oct 31 07:45:17.279839 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.279812    5039 generic.go:356] "Generic (PLEG): container finished" podID="6d2ec944-1203-4c38-8f6c-fdb5c0646d56" containerID="e1011f885a2bc3f0cfcfd44c9b31d276cc3ef8512478a1a5a3c97cfe5df569dd" exitCode=0
Oct 31 07:45:17.279978 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.279892    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2" event={"ID":"6d2ec944-1203-4c38-8f6c-fdb5c0646d56","Type":"ContainerDied","Data":"e1011f885a2bc3f0cfcfd44c9b31d276cc3ef8512478a1a5a3c97cfe5df569dd"}
Oct 31 07:45:17.290868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.290243    5039 generic.go:356] "Generic (PLEG): container finished" podID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerID="e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc" exitCode=0
Oct 31 07:45:17.290868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.290311    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" event={"ID":"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc","Type":"ContainerDied","Data":"e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc"}
Oct 31 07:45:17.290868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.290352    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm" event={"ID":"9788c2a9-b8cf-48ec-8c2d-128b0e9289fc","Type":"ContainerDied","Data":"bb87f3917736421d62fe27d668a79be0c601573364e28a4497a8a983133d78ac"}
Oct 31 07:45:17.290868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.290414    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"
Oct 31 07:45:17.302234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.302115    5039 scope.go:122] "RemoveContainer" containerID="fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63"
Oct 31 07:45:17.303607 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:17.303577    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63\": container with ID starting with fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63 not found: ID does not exist" containerID="fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63"
Oct 31 07:45:17.303750 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.303614    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63"} err="failed to get container status \"fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63\": rpc error: code = NotFound desc = could not find container \"fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63\": container with ID starting with fe41bcee8813f9b97777dbb2656b1fa1be622ac63952ccd6432e680530cf5a63 not found: ID does not exist"
Oct 31 07:45:17.303750 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.303635    5039 scope.go:122] "RemoveContainer" containerID="e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc"
Oct 31 07:45:17.315035 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.315015    5039 scope.go:122] "RemoveContainer" containerID="e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc"
Oct 31 07:45:17.315391 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:17.315367    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc\": container with ID starting with e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc not found: ID does not exist" containerID="e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc"
Oct 31 07:45:17.315486 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.315397    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc"} err="failed to get container status \"e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc\": rpc error: code = NotFound desc = could not find container \"e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc\": container with ID starting with e47ace34cd79fac323e0d6c3653a73d26f6ba95ce9ee812164bfac5ef939f3cc not found: ID does not exist"
Oct 31 07:45:17.386720 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.386684    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"]
Oct 31 07:45:17.390378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.390350    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/simulator-w4-3dff3f-kserve-9b6444689-k4r9x"]
Oct 31 07:45:17.423056 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.422982    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"]
Oct 31 07:45:17.424713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.424691    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-3dff3f/distinct-w4-3dff3f-kserve-5f5d79664c-t4fwm"]
Oct 31 07:45:17.617443 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.617414    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" path="/var/lib/kubelet/pods/18a15066-1fa5-40bc-94c5-3252031312c8/volumes"
Oct 31 07:45:17.617910 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:17.617895    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" path="/var/lib/kubelet/pods/9788c2a9-b8cf-48ec-8c2d-128b0e9289fc/volumes"
Oct 31 07:45:18.451318 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.451283    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:18.493374 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.493343    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:18.594985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.594882    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-xks-ca\") pod \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") "
Oct 31 07:45:18.595167 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.595027    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-openshift-ca\") pod \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") "
Oct 31 07:45:18.595167 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.595127    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-kube-api-access-g579r\" (UniqueName: \"kubernetes.io/projected/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-kube-api-access-g579r\") pod \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\" (UID: \"6d2ec944-1203-4c38-8f6c-fdb5c0646d56\") "
Oct 31 07:45:18.596020 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.595988    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-openshift-ca" pod "6d2ec944-1203-4c38-8f6c-fdb5c0646d56" (UID: "6d2ec944-1203-4c38-8f6c-fdb5c0646d56"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:18.597769 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.597728    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-xks-ca" pod "6d2ec944-1203-4c38-8f6c-fdb5c0646d56" (UID: "6d2ec944-1203-4c38-8f6c-fdb5c0646d56"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:18.600142 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.600109    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-kube-api-access-g579r" pod "6d2ec944-1203-4c38-8f6c-fdb5c0646d56" (UID: "6d2ec944-1203-4c38-8f6c-fdb5c0646d56"). InnerVolumeSpecName "kube-api-access-g579r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:18.697139 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.697101    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:18.697391 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.697370    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:18.697496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.697482    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g579r\" (UniqueName: \"kubernetes.io/projected/6d2ec944-1203-4c38-8f6c-fdb5c0646d56-kube-api-access-g579r\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:18.935887 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.935787    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"]
Oct 31 07:45:18.936611 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.936585    5039 cpu_manager.go:414] "containerMap: removing container" podUID="6d2ec944-1203-4c38-8f6c-fdb5c0646d56" containerName="revoke-keys"
Oct 31 07:45:18.936611 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.936611    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6d2ec944-1203-4c38-8f6c-fdb5c0646d56" containerName="revoke-keys"
Oct 31 07:45:18.936783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.936630    5039 cpu_manager.go:414] "containerMap: removing container" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main"
Oct 31 07:45:18.936783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.936636    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main"
Oct 31 07:45:18.936783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.936664    5039 cpu_manager.go:414] "containerMap: removing container" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main"
Oct 31 07:45:18.936783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.936669    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main"
Oct 31 07:45:18.936783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.936766    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="9788c2a9-b8cf-48ec-8c2d-128b0e9289fc" containerName="main"
Oct 31 07:45:18.936783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.936779    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="6d2ec944-1203-4c38-8f6c-fdb5c0646d56" containerName="revoke-keys"
Oct 31 07:45:18.936783 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.936788    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="18a15066-1fa5-40bc-94c5-3252031312c8" containerName="main"
Oct 31 07:45:18.940266 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.940245    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:18.979583 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:18.975041    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"]
Oct 31 07:45:19.014465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.013762    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.014465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.013806    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.014465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.013846    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.014465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.013887    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.014465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.013931    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.014465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.014049    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62dwv\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-kube-api-access-62dwv\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.014465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.014106    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.014465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.014162    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.014465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.014234    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.052964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.049263    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"]
Oct 31 07:45:19.052964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.049357    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"]
Oct 31 07:45:19.052964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.049466    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.061621 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.061562    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"]
Oct 31 07:45:19.066386 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.066272    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.076408 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.076371    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"]
Oct 31 07:45:19.117480 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.117303    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.117720 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.117695    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.117893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.117872    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.118050 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.118032    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.118169 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.118153    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.118275 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.118260    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.118397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.118382    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d872d9-8044-41f9-b3ff-5a530abf893d-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.118518 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.118500    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.118626 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.118611    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.118756 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.118740    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.118928 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.118895    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.119089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.119073    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.119213 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.119198    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62dwv\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-kube-api-access-62dwv\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.119372 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.119315    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.119510 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.119494    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.119628 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.119613    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.119716 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.119695    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.119791 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.119738    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.119894 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.119508    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.120084 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.120065    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.120240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.120222    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.120354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.120338    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.120567 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.120549    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.120707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.120692    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.120815 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.120800    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.120979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.120962    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.121133 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.121117    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtbst\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-kube-api-access-dtbst\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.121240 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.121226    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.121361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.121346    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvj2z\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-kube-api-access-gvj2z\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.121494 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.121477    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.121698 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.120399    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.122169 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.122107    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.122824 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.122800    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.124956 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.124931    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:19.129390 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.129358    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.149569 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.149529    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62dwv\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-kube-api-access-62dwv\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.165451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.165381    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.222534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222479    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.222741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222551    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.222741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222609    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtbst\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-kube-api-access-dtbst\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.222741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222679    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.222741 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222714    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvj2z\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-kube-api-access-gvj2z\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.222982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222756    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.222982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222805    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.222982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222835    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.222982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222866    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.222982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.222901    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d872d9-8044-41f9-b3ff-5a530abf893d-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.223236 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223008    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.223236 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223073    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.223236 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223103    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-credential-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.223236 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223128    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.223236 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223177    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.223236 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223210    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-data\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.223534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223218    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.223534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223329    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.223534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223413    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.223534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223460    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-credential-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.223534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223467    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.223534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223506    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-socket\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.223534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223263    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-certs\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.223880 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223730    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-data\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.223880 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223802    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d872d9-8044-41f9-b3ff-5a530abf893d-istiod-ca-cert\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.224029 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.223963    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-certs\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.224029 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.224004    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-socket\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.224273 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.224248    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istiod-ca-cert\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.225307 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.225279    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-envoy\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.225432 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.225317    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-envoy\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.226034 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.226014    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-podinfo\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.226121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.226103    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-podinfo\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.240532 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.240498    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvj2z\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-kube-api-access-gvj2z\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.240641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.240621    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-token\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.240967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.240949    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-token\") pod \"e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") " pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.241239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.241219    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtbst\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-kube-api-access-dtbst\") pod \"e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") " pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.260298 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.260266    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:19.319597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.319504    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:19.323986 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.323948    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2" event={"ID":"6d2ec944-1203-4c38-8f6c-fdb5c0646d56","Type":"ContainerDied","Data":"8fc875d00ac12945ca5a9b73fca6bd8e16b4f3af438041b10b475831c4d18f77"}
Oct 31 07:45:19.324153 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.324013    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fc875d00ac12945ca5a9b73fca6bd8e16b4f3af438041b10b475831c4d18f77"
Oct 31 07:45:19.324153 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.323971    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"
Oct 31 07:45:19.367659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.367623    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:19.394981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.394946    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:19.509004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.508970    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:19.528933 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.528883    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b" podUID="9ec6f58c-cc28-4dd8-b87f-03085f51a69c" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:45:19.598421 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.598396    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"]
Oct 31 07:45:19.605259 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.605220    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:45:19.605385 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.605302    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:45:19.605385 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.605334    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:45:19.613261 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.609424    5039 scope.go:122] "RemoveContainer" containerID="ef09f2257ea4610485bacc3a6b9e89ec177dea10c08f6492d14cdbc98ff9fbba"
Oct 31 07:45:19.710506 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.710444    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"]
Oct 31 07:45:19.711038 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.711015    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:19.713486 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:45:19.713458    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb9040a4_bc18_4188_908c_1f3a4b2f97cd.slice/crio-34c82f0999c68e55c229c8bbdd3d2c8c0436524210b85dbdaab6c6d7c36b9e55 WatchSource:0}: Error finding container 34c82f0999c68e55c229c8bbdd3d2c8c0436524210b85dbdaab6c6d7c36b9e55: Status 404 returned error can't find the container with id 34c82f0999c68e55c229c8bbdd3d2c8c0436524210b85dbdaab6c6d7c36b9e55
Oct 31 07:45:19.716802 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.716764    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:45:19.716881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.716857    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:45:19.716979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.716899    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:45:19.730026 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.729999    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"]
Oct 31 07:45:19.736846 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:45:19.736810    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d872d9_8044_41f9_b3ff_5a530abf893d.slice/crio-17b457c2bfd4fd32022e793b9a1e9190b0a2e7e5acfa01fb5bec8010ac98a0d4 WatchSource:0}: Error finding container 17b457c2bfd4fd32022e793b9a1e9190b0a2e7e5acfa01fb5bec8010ac98a0d4: Status 404 returned error can't find the container with id 17b457c2bfd4fd32022e793b9a1e9190b0a2e7e5acfa01fb5bec8010ac98a0d4
Oct 31 07:45:19.740591 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.740017    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:45:19.740591 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.740103    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:45:19.740591 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.740153    5039 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236076Ki","pods":"250"}
Oct 31 07:45:19.931566 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:19.931521    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:20.334638 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.334539    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" event={"ID":"db9040a4-bc18-4188-908c-1f3a4b2f97cd","Type":"ContainerStarted","Data":"4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565"}
Oct 31 07:45:20.334803 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.334641    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" event={"ID":"db9040a4-bc18-4188-908c-1f3a4b2f97cd","Type":"ContainerStarted","Data":"34c82f0999c68e55c229c8bbdd3d2c8c0436524210b85dbdaab6c6d7c36b9e55"}
Oct 31 07:45:20.336405 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.336366    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" event={"ID":"76d272c4-24c8-4ca8-8945-b72ccae3bdc8","Type":"ContainerStarted","Data":"00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685"}
Oct 31 07:45:20.336569 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.336432    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" event={"ID":"76d272c4-24c8-4ca8-8945-b72ccae3bdc8","Type":"ContainerStarted","Data":"add2673903fbf8b3e61e3a8772cbd315844137e149b8cef6e0f5f20fd01ec78f"}
Oct 31 07:45:20.338445 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.338419    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" event={"ID":"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da","Type":"ContainerStarted","Data":"afce92d5ffc6a50bd849b02b59aed5fceb962c505338ae2a9023df6a604b3903"}
Oct 31 07:45:20.340184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.340153    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" event={"ID":"48d872d9-8044-41f9-b3ff-5a530abf893d","Type":"ContainerStarted","Data":"a98efa9df7974f5ae6c16aebdf1da38cc75dffb93be17bb841ef7f667e28db28"}
Oct 31 07:45:20.340265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.340204    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" event={"ID":"48d872d9-8044-41f9-b3ff-5a530abf893d","Type":"ContainerStarted","Data":"17b457c2bfd4fd32022e793b9a1e9190b0a2e7e5acfa01fb5bec8010ac98a0d4"}
Oct 31 07:45:20.368139 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.368096    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:20.370659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.370615    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:20.370805 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.370697    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:20.382901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.382820    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podStartSLOduration=2.382799374 podStartE2EDuration="2.382799374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:20.377886446 +0000 UTC m=+1034.907081119" watchObservedRunningTime="2026-10-31 07:45:20.382799374 +0000 UTC m=+1034.911994050"
Oct 31 07:45:20.397369 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.397327    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:20.403004 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.402960    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:20.403411 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.403339    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:20.422984 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.422887    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podStartSLOduration=2.422874173 podStartE2EDuration="2.422874173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:20.421591018 +0000 UTC m=+1034.950785692" watchObservedRunningTime="2026-10-31 07:45:20.422874173 +0000 UTC m=+1034.952068923"
Oct 31 07:45:20.485824 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.485791    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:20.509315 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:20.509256    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podStartSLOduration=1.509239413 podStartE2EDuration="1.509239413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:20.505462844 +0000 UTC m=+1035.034657519" watchObservedRunningTime="2026-10-31 07:45:20.509239413 +0000 UTC m=+1035.038434086"
Oct 31 07:45:21.261329 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.261293    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:21.284143 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.284093    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:21.284425 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.284384    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:21.358158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.352425    5039 generic.go:356] "Generic (PLEG): container finished" podID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerID="afce92d5ffc6a50bd849b02b59aed5fceb962c505338ae2a9023df6a604b3903" exitCode=60
Oct 31 07:45:21.358158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.352746    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" event={"ID":"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da","Type":"ContainerDied","Data":"afce92d5ffc6a50bd849b02b59aed5fceb962c505338ae2a9023df6a604b3903"}
Oct 31 07:45:21.358158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.352817    5039 scope.go:122] "RemoveContainer" containerID="ef09f2257ea4610485bacc3a6b9e89ec177dea10c08f6492d14cdbc98ff9fbba"
Oct 31 07:45:21.366941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.358763    5039 scope.go:122] "RemoveContainer" containerID="afce92d5ffc6a50bd849b02b59aed5fceb962c505338ae2a9023df6a604b3903"
Oct 31 07:45:21.366941 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:21.359222    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29890545-jjm7v_odh-ai-gateway-infra(f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da"
Oct 31 07:45:21.368798 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.368763    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:21.369042 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.369018    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:21.370397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.370340    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:21.434561 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.434523    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:21.439028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.438691    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:21.605001 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.587969    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"]
Oct 31 07:45:21.628787 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.628754    5039 scope.go:122] "RemoveContainer" containerID="9ecbcda0890730a9cd10dff038521ccf851c1678fafc7286de87ae0d67eda891"
Oct 31 07:45:21.660964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.638524    5039 scope.go:122] "RemoveContainer" containerID="5ca7ef4bb0c40312c4d34a30110b84d2d0b989497d25141f553fd3127ece8332"
Oct 31 07:45:21.912174 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.911354    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"]
Oct 31 07:45:21.965939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:21.948354    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:22.278037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:22.263948    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:22.278037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:22.264010    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:22.357674 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:22.357614    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:22.404963 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:22.400519    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:22.404963 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:22.400584    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:22.497960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:22.423779    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:22.497960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:22.423844    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:23.177993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.177950    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:23.307519 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.307423    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:23.307798 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.307755    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:23.423830 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.421813    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:23.423830 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.421880    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:23.425160 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.424154    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:23.425160 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.424200    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:23.448236 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.448201    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:23.569493 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.535933    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-maas-api-service-ca\") pod \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\" (UID: \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\") "
Oct 31 07:45:23.675243 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.541482    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-maas-api-service-ca" pod "f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" (UID: "f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:23.675602 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.675549    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-kube-api-access-6xmp4\" (UniqueName: \"kubernetes.io/projected/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-kube-api-access-6xmp4\") pod \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\" (UID: \"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da\") "
Oct 31 07:45:23.709695 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.709650    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-maas-api-service-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:23.740785 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.740740    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-kube-api-access-6xmp4" pod "f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" (UID: "f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da"). InnerVolumeSpecName "kube-api-access-6xmp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:23.858942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.851435    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v" event={"ID":"f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da","Type":"ContainerDied","Data":"69d087753f583086066e351a059504949328bf19051584c46da8e0923dea632d"}
Oct 31 07:45:23.858942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.851540    5039 scope.go:122] "RemoveContainer" containerID="afce92d5ffc6a50bd849b02b59aed5fceb962c505338ae2a9023df6a604b3903"
Oct 31 07:45:23.858942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.851775    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"
Oct 31 07:45:23.943025 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.905643    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:23.943025 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.909500    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" event={"ID":"5768b5e5-af88-42c7-8784-057cc0280a2b","Type":"ContainerStarted","Data":"5461755cef4ca6b2025a8229eb5ae79884f2de8ece16a145b980605a4c880468"}
Oct 31 07:45:23.943025 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.934457    5039 scope.go:122] "RemoveContainer" containerID="5461755cef4ca6b2025a8229eb5ae79884f2de8ece16a145b980605a4c880468"
Oct 31 07:45:23.943025 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:23.934880    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm_odh-ai-gateway-infra(5768b5e5-af88-42c7-8784-057cc0280a2b)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b"
Oct 31 07:45:24.002942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:23.990201    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" event={"ID":"50bdd918-5e8c-4701-b088-e29fce34b180","Type":"ContainerStarted","Data":"d3ffccd177639bbbf0be80ddca4a97ba631d7082afa49c039730c998dc07703f"}
Oct 31 07:45:24.027342 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.027283    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xmp4\" (UniqueName: \"kubernetes.io/projected/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da-kube-api-access-6xmp4\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:24.128023 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.110752    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:24.250462 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.250386    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"]
Oct 31 07:45:24.260823 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.260784    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29890545-jjm7v"]
Oct 31 07:45:24.284985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.284597    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:24.284985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.284675    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:24.368265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.368227    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:24.368518 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.368487    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:24.398410 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.398310    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:24.398677 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.398645    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:24.909952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.909031    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": context deadline exceeded"
Oct 31 07:45:24.989932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.989867    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:24.994549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:24.993141    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 31 07:45:25.011985 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.011952    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"]
Oct 31 07:45:25.046951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.037558    5039 generic.go:356] "Generic (PLEG): container finished" podID="50bdd918-5e8c-4701-b088-e29fce34b180" containerID="d3ffccd177639bbbf0be80ddca4a97ba631d7082afa49c039730c998dc07703f" exitCode=60
Oct 31 07:45:25.046951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.037733    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" event={"ID":"50bdd918-5e8c-4701-b088-e29fce34b180","Type":"ContainerDied","Data":"d3ffccd177639bbbf0be80ddca4a97ba631d7082afa49c039730c998dc07703f"}
Oct 31 07:45:25.046951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.037799    5039 scope.go:122] "RemoveContainer" containerID="9ecbcda0890730a9cd10dff038521ccf851c1678fafc7286de87ae0d67eda891"
Oct 31 07:45:25.046951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.038316    5039 scope.go:122] "RemoveContainer" containerID="d3ffccd177639bbbf0be80ddca4a97ba631d7082afa49c039730c998dc07703f"
Oct 31 07:45:25.046951 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:25.038718    5039 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw_odh-ai-gateway-infra(50bdd918-5e8c-4701-b088-e29fce34b180)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" podUID="50bdd918-5e8c-4701-b088-e29fce34b180"
Oct 31 07:45:25.097892 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.084140    5039 generic.go:356] "Generic (PLEG): container finished" podID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerID="5461755cef4ca6b2025a8229eb5ae79884f2de8ece16a145b980605a4c880468" exitCode=60
Oct 31 07:45:25.097892 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.084367    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" event={"ID":"5768b5e5-af88-42c7-8784-057cc0280a2b","Type":"ContainerDied","Data":"5461755cef4ca6b2025a8229eb5ae79884f2de8ece16a145b980605a4c880468"}
Oct 31 07:45:25.135891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.135868    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"]
Oct 31 07:45:25.136878 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.136203    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:25.152096 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.152051    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:25.249856 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.249827    5039 scope.go:122] "RemoveContainer" containerID="5ca7ef4bb0c40312c4d34a30110b84d2d0b989497d25141f553fd3127ece8332"
Oct 31 07:45:25.261900 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.261866    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:25.274951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.262455    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:25.368411 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.368337    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:25.385129 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.374975    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:25.410990 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.410950    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:25.411201 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.411104    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:25.727735 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.727689    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" path="/var/lib/kubelet/pods/f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da/volumes"
Oct 31 07:45:25.912532 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.912429    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:25.913339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.913298    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:45:26.016037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.993359    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:26.016037 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:25.993805    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:45:26.234387 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.217438    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": context deadline exceeded"
Oct 31 07:45:26.234387 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.218037    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:45:26.435138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.430032    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:26.496184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.472006    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:26.496184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.472082    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:26.496184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.472352    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:26.496184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.472390    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:26.496184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.472699    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:26.496184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.472737    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:26.686560 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:26.583376    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:27.094163 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.094113    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:27.590398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.094979    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": context deadline exceeded"
Oct 31 07:45:27.611314 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.136782    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c" podUID="d0b234c3-44e8-4a22-96a3-c758c7cb8af4" containerName="payload-pre-processing" containerID="cri-o://485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26" gracePeriod=25
Oct 31 07:45:27.617944 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.283072    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:27.618248 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.346261    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:27.637969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.475375    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:27.637969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.623217    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:27.637969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.523791    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:27.637969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.475452    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:27.637969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.524173    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:27.637969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.623886    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:27.637969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.570587    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:27.637969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.623997    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:27.637969 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.624195    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:45:27.666355 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.664290    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": context deadline exceeded"
Oct 31 07:45:27.938995 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.928573    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:45:27.938995 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.928649    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:27.938995 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:27.934937    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:28.108980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.108943    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:45:28.191111 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.191014    5039 patch_prober.go:29] interesting pod/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:45:28.191366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.191333    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:28.267902 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.267865    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"]
Oct 31 07:45:28.320177 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.313596    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:28.320733 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.320048    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:28.320949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.320904    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:28.451993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.429070    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:28.451993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.429137    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:28.451993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.429888    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5768b5e5-af88-42c7-8784-057cc0280a2b-kube-api-access-tzvbd\" (UniqueName: \"kubernetes.io/projected/5768b5e5-af88-42c7-8784-057cc0280a2b-kube-api-access-tzvbd\") pod \"5768b5e5-af88-42c7-8784-057cc0280a2b\" (UID: \"5768b5e5-af88-42c7-8784-057cc0280a2b\") "
Oct 31 07:45:28.451993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.430094    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5768b5e5-af88-42c7-8784-057cc0280a2b-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5768b5e5-af88-42c7-8784-057cc0280a2b-maas-api-service-ca\") pod \"5768b5e5-af88-42c7-8784-057cc0280a2b\" (UID: \"5768b5e5-af88-42c7-8784-057cc0280a2b\") "
Oct 31 07:45:28.451993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.446473    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:28.451993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.446649    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:28.451993 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.447457    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5768b5e5-af88-42c7-8784-057cc0280a2b-maas-api-service-ca" pod "5768b5e5-af88-42c7-8784-057cc0280a2b" (UID: "5768b5e5-af88-42c7-8784-057cc0280a2b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:28.466488 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.466413    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"]
Oct 31 07:45:28.466884 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.466863    5039 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 07:45:28.689047 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.653978    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:28.691660 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.690869    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5768b5e5-af88-42c7-8784-057cc0280a2b-maas-api-service-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:28.691660 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.690961    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 31 07:45:28.762942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.738013    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": context deadline exceeded"
Oct 31 07:45:28.780140 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.780078    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:45:28.789110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.789049    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.91:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:28.811965 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.738957    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 07:45:28.837941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.739636    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": context deadline exceeded"
Oct 31 07:45:28.922942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:28.896095    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5768b5e5-af88-42c7-8784-057cc0280a2b-kube-api-access-tzvbd" pod "5768b5e5-af88-42c7-8784-057cc0280a2b" (UID: "5768b5e5-af88-42c7-8784-057cc0280a2b"). InnerVolumeSpecName "kube-api-access-tzvbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:29.023999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.023462    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"]
Oct 31 07:45:29.023999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.023562    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"]
Oct 31 07:45:29.023999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.023596    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"]
Oct 31 07:45:29.023999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.023818    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy" containerID="cri-o://82436e6e5ad508c1ac90b2e26450f959054891527a8af17adfe06f88e551524f" gracePeriod=30
Oct 31 07:45:29.041945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.024589    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerName="istio-proxy" containerID="cri-o://194ec64d4fcd2b522d3a9959990b03e28be0e16393793215fb667bc34cc8f3b6" gracePeriod=30
Oct 31 07:45:29.041945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.024815    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy" containerID="cri-o://c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c" gracePeriod=30
Oct 31 07:45:29.096599 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.096553    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzvbd\" (UniqueName: \"kubernetes.io/projected/5768b5e5-af88-42c7-8784-057cc0280a2b-kube-api-access-tzvbd\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:29.166707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.137031    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:29.658960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.294357    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:29.658960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.633753    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:29.658960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.551778    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:45:29.658960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.635074    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c" podUID="d0b234c3-44e8-4a22-96a3-c758c7cb8af4" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:45:29.769943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.454092    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:29.769943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.769937    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:29.779450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.459486    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:29.779450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.770004    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:29.779450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.774275    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:29.779450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.774837    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": context deadline exceeded"
Oct 31 07:45:29.861939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.861573    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded"
Oct 31 07:45:29.893178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.876285    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:29.897448 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.894436    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b" podUID="9ec6f58c-cc28-4dd8-b87f-03085f51a69c" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:45:29.947546 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.947445    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:45:29.947856 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.947761    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.98:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:29.965015 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:29.964963    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"
Oct 31 07:45:30.058388 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:30.058340    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:45:30.312974 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.312120    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm" event={"ID":"5768b5e5-af88-42c7-8784-057cc0280a2b","Type":"ContainerDied","Data":"aade0728673b747dc3b149bc4f74c1bece774c2a43679a14bc522573e11c2027"}
Oct 31 07:45:30.312974 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.312192    5039 scope.go:122] "RemoveContainer" containerID="5461755cef4ca6b2025a8229eb5ae79884f2de8ece16a145b980605a4c880468"
Oct 31 07:45:30.312974 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.312847    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:30.320878 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.312899    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:30.354940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.354284    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:30.372014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.371558    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:30.372014 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.371617    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:30.434941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.428133    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:30.434941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.428199    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:30.473211 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.473176    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50bdd918-5e8c-4701-b088-e29fce34b180-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bdd918-5e8c-4701-b088-e29fce34b180-maas-api-service-ca\") pod \"50bdd918-5e8c-4701-b088-e29fce34b180\" (UID: \"50bdd918-5e8c-4701-b088-e29fce34b180\") "
Oct 31 07:45:30.474158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.474124    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50bdd918-5e8c-4701-b088-e29fce34b180-kube-api-access-7svfq\" (UniqueName: \"kubernetes.io/projected/50bdd918-5e8c-4701-b088-e29fce34b180-kube-api-access-7svfq\") pod \"50bdd918-5e8c-4701-b088-e29fce34b180\" (UID: \"50bdd918-5e8c-4701-b088-e29fce34b180\") "
Oct 31 07:45:30.475341 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.473763    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50bdd918-5e8c-4701-b088-e29fce34b180-maas-api-service-ca" pod "50bdd918-5e8c-4701-b088-e29fce34b180" (UID: "50bdd918-5e8c-4701-b088-e29fce34b180"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:30.684837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.663647    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50bdd918-5e8c-4701-b088-e29fce34b180-kube-api-access-7svfq" pod "50bdd918-5e8c-4701-b088-e29fce34b180" (UID: "50bdd918-5e8c-4701-b088-e29fce34b180"). InnerVolumeSpecName "kube-api-access-7svfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:30.684837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.664821    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7svfq\" (UniqueName: \"kubernetes.io/projected/50bdd918-5e8c-4701-b088-e29fce34b180-kube-api-access-7svfq\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:30.684837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.664848    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/50bdd918-5e8c-4701-b088-e29fce34b180-maas-api-service-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:30.684837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.681022    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"]
Oct 31 07:45:30.684837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.681079    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-4794f5-29890545-zp4wm"]
Oct 31 07:45:30.817987 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.808336    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" probeResult="failure" output="Get \"https://10.132.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:30.817987 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.808650    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" probeResult="failure" output="Get \"https://10.132.0.71:8000/ready\": context deadline exceeded"
Oct 31 07:45:30.817987 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.815779    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:30.817987 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.815872    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" probeResult="failure" output="Get \"https://10.132.0.95:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:30.845876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.845845    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:45:30.851090 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.851057    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:45:30.934705 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:30.912504    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" probeResult="failure" output="Get \"https://10.132.0.74:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:31.009337 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.009303    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:45:31.048946 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.048259    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:45:31.091728 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.091685    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main" containerID="cri-o://2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0" gracePeriod=45
Oct 31 07:45:31.119092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.113222    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:31.119394 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.114930    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw" event={"ID":"50bdd918-5e8c-4701-b088-e29fce34b180","Type":"ContainerDied","Data":"da867bbe90ddf61c23a381a0c746de27f9385c65f13f3396b164e7163f40272d"}
Oct 31 07:45:31.119604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.119587    5039 scope.go:122] "RemoveContainer" containerID="d3ffccd177639bbbf0be80ddca4a97ba631d7082afa49c039730c998dc07703f"
Oct 31 07:45:31.119811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.115187    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"
Oct 31 07:45:31.272747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.272712    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused" start-of-body=
Oct 31 07:45:31.272981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.272953    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.106:15021/healthz/ready\": dial tcp 10.132.0.106:15021: connect: connection refused"
Oct 31 07:45:31.309389 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.309237    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"]
Oct 31 07:45:31.339884 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.338185    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-3dff3f-29890545-hsbfw"]
Oct 31 07:45:31.367938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.365418    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:31.374023 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.370386    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:31.374023 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.370452    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:31.395577 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.395456    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused" start-of-body=
Oct 31 07:45:31.395577 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.395518    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": dial tcp 10.132.0.108:15021: connect: connection refused"
Oct 31 07:45:31.646197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.646164    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" path="/var/lib/kubelet/pods/50bdd918-5e8c-4701-b088-e29fce34b180/volumes"
Oct 31 07:45:31.647218 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.647190    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" path="/var/lib/kubelet/pods/5768b5e5-af88-42c7-8784-057cc0280a2b/volumes"
Oct 31 07:45:31.657624 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.657594    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.792374    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-home\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-home\") pod \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") "
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.792443    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-dshm\") pod \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") "
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.792555    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-model-cache\") pod \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") "
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.792716    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tmp-dir\") pod \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") "
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.792781    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-kube-api-access-24lwq\" (UniqueName: \"kubernetes.io/projected/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-kube-api-access-24lwq\") pod \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") "
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.792814    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tls-certs\" (UniqueName: \"kubernetes.io/secret/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tls-certs\") pod \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\" (UID: \"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2\") "
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.793333    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-model-cache" pod "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" (UID: "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.793518    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.793764    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-home" pod "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" (UID: "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:31.795009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.794603    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tmp-dir" pod "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" (UID: "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:31.800552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.800504    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-dshm" pod "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" (UID: "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:31.800826 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.800791    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tls-certs" pod "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" (UID: "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:31.833973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.830422    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-kube-api-access-24lwq" pod "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" (UID: "7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2"). InnerVolumeSpecName "kube-api-access-24lwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:31.897937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.895846    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:31.897937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.895890    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:31.897937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.895905    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:31.897937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.895935    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24lwq\" (UniqueName: \"kubernetes.io/projected/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-kube-api-access-24lwq\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:31.897937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:31.895953    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:32.029591 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.029541    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:32.324945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.323807    5039 generic.go:356] "Generic (PLEG): container finished" podID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerID="2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0" exitCode=0
Oct 31 07:45:32.324945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.323906    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" event={"ID":"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2","Type":"ContainerDied","Data":"2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0"}
Oct 31 07:45:32.324945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.323959    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds" event={"ID":"7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2","Type":"ContainerDied","Data":"98d9bb8a1cd056e9a03ba4b56f70e239d3ccb2f801b2bbcf4d55633f785bd25e"}
Oct 31 07:45:32.324945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.324000    5039 scope.go:122] "RemoveContainer" containerID="2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0"
Oct 31 07:45:32.324945 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.324117    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"
Oct 31 07:45:32.394941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.371119    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Oct 31 07:45:32.394941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.371184    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Oct 31 07:45:32.394941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.378426    5039 scope.go:122] "RemoveContainer" containerID="2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0"
Oct 31 07:45:32.394941 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:32.379002    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0\": container with ID starting with 2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0 not found: ID does not exist" containerID="2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0"
Oct 31 07:45:32.394941 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.379040    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0"} err="failed to get container status \"2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0\": rpc error: code = NotFound desc = could not find container \"2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0\": container with ID starting with 2798cf4c7ebc1ec6e2a74df71d8d4c57e6397c3885eb11ff7055578bf12de7d0 not found: ID does not exist"
Oct 31 07:45:32.418257 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.403137    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"]
Oct 31 07:45:32.435129 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.435087    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-3cc201/simulator-w3-3cc201-kserve-745bc8694-8t4ds"]
Oct 31 07:45:32.626096 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.622965    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:32.701948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.696383    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:32.701948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.698367    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:32.719897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.719239    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:45:32.985009 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:32.984891    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:33.222672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.222643    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:33.386843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.386810    5039 generic.go:356] "Generic (PLEG): container finished" podID="9ec6f58c-cc28-4dd8-b87f-03085f51a69c" containerID="d9c51860abe82c7ba7225d9f2bf05c87c9b6a9f73d366a6424e9a6bfa97498ca" exitCode=0
Oct 31 07:45:33.387155 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.387129    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b" event={"ID":"9ec6f58c-cc28-4dd8-b87f-03085f51a69c","Type":"ContainerDied","Data":"d9c51860abe82c7ba7225d9f2bf05c87c9b6a9f73d366a6424e9a6bfa97498ca"}
Oct 31 07:45:33.407549 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.407513    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:45:33.407808 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.407765    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:33.585302 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.583860    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:33.615064 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.608126    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:33.636748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.634714    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:45:33.679953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.679782    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" path="/var/lib/kubelet/pods/7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2/volumes"
Oct 31 07:45:33.687022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.686992    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:45:33.730125 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.728363    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-kube-api-access-k2dvt\" (UniqueName: \"kubernetes.io/projected/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-kube-api-access-k2dvt\") pod \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\" (UID: \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\") "
Oct 31 07:45:33.730125 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.728719    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-plugins-config-volume\") pod \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\" (UID: \"9ec6f58c-cc28-4dd8-b87f-03085f51a69c\") "
Oct 31 07:45:33.749531 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.749493    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-plugins-config-volume" pod "9ec6f58c-cc28-4dd8-b87f-03085f51a69c" (UID: "9ec6f58c-cc28-4dd8-b87f-03085f51a69c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:33.831024 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.830755    5039 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-plugins-config-volume\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:33.841535 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.841417    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-kube-api-access-k2dvt" pod "9ec6f58c-cc28-4dd8-b87f-03085f51a69c" (UID: "9ec6f58c-cc28-4dd8-b87f-03085f51a69c"). InnerVolumeSpecName "kube-api-access-k2dvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:33.937110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:33.932809    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2dvt\" (UniqueName: \"kubernetes.io/projected/9ec6f58c-cc28-4dd8-b87f-03085f51a69c-kube-api-access-k2dvt\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.413426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.413330    5039 generic.go:356] "Generic (PLEG): container finished" podID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerID="82436e6e5ad508c1ac90b2e26450f959054891527a8af17adfe06f88e551524f" exitCode=0
Oct 31 07:45:34.414422 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.414389    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" event={"ID":"0d46ac1c-71c4-4f3c-af7e-f4de12cee963","Type":"ContainerDied","Data":"82436e6e5ad508c1ac90b2e26450f959054891527a8af17adfe06f88e551524f"}
Oct 31 07:45:34.417177 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.417133    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b" event={"ID":"9ec6f58c-cc28-4dd8-b87f-03085f51a69c","Type":"ContainerDied","Data":"2c582e29773bb6cd9ee01dbd86285db769cd648e7727452f4d603b24d5b12152"}
Oct 31 07:45:34.417381 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.417362    5039 scope.go:122] "RemoveContainer" containerID="d9c51860abe82c7ba7225d9f2bf05c87c9b6a9f73d366a6424e9a6bfa97498ca"
Oct 31 07:45:34.417656 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.417638    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"
Oct 31 07:45:34.427330 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.425687    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:34.431345 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.431121    5039 generic.go:356] "Generic (PLEG): container finished" podID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerID="194ec64d4fcd2b522d3a9959990b03e28be0e16393793215fb667bc34cc8f3b6" exitCode=0
Oct 31 07:45:34.431462 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.431399    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" event={"ID":"c5c516fb-b637-43d1-863e-0916ad4f8457","Type":"ContainerDied","Data":"194ec64d4fcd2b522d3a9959990b03e28be0e16393793215fb667bc34cc8f3b6"}
Oct 31 07:45:34.501032 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.499986    5039 patch_prober.go:29] interesting pod/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:45:34.501032 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.500064    5039 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.108:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:45:34.534209 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.533606    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:34.582049 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.573844    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"]
Oct 31 07:45:34.696264 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.696150    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-3dff3f-65f55ff767-5fb9b"]
Oct 31 07:45:34.851234 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.851204    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:45:34.872398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.872370    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:45:34.885645 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.885435    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-envoy\") pod \"c5c516fb-b637-43d1-863e-0916ad4f8457\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") "
Oct 31 07:45:34.885645 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.885513    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-credential-socket\") pod \"c5c516fb-b637-43d1-863e-0916ad4f8457\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") "
Oct 31 07:45:34.885645 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.885557    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-data\") pod \"c5c516fb-b637-43d1-863e-0916ad4f8457\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") "
Oct 31 07:45:34.885645 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.885629    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-kube-api-access-ff88r\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-kube-api-access-ff88r\") pod \"c5c516fb-b637-43d1-863e-0916ad4f8457\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") "
Oct 31 07:45:34.887296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.885668    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-token\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-token\") pod \"c5c516fb-b637-43d1-863e-0916ad4f8457\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") "
Oct 31 07:45:34.887296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.885724    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c5c516fb-b637-43d1-863e-0916ad4f8457-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5c516fb-b637-43d1-863e-0916ad4f8457-istiod-ca-cert\") pod \"c5c516fb-b637-43d1-863e-0916ad4f8457\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") "
Oct 31 07:45:34.887296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.885835    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-podinfo\") pod \"c5c516fb-b637-43d1-863e-0916ad4f8457\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") "
Oct 31 07:45:34.887296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.885936    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-socket\") pod \"c5c516fb-b637-43d1-863e-0916ad4f8457\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") "
Oct 31 07:45:34.887296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.886053    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-certs\") pod \"c5c516fb-b637-43d1-863e-0916ad4f8457\" (UID: \"c5c516fb-b637-43d1-863e-0916ad4f8457\") "
Oct 31 07:45:34.887296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.886995    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-certs" pod "c5c516fb-b637-43d1-863e-0916ad4f8457" (UID: "c5c516fb-b637-43d1-863e-0916ad4f8457"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:34.907267 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.907230    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5c516fb-b637-43d1-863e-0916ad4f8457-istiod-ca-cert" pod "c5c516fb-b637-43d1-863e-0916ad4f8457" (UID: "c5c516fb-b637-43d1-863e-0916ad4f8457"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:34.932095 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.931882    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-data" pod "c5c516fb-b637-43d1-863e-0916ad4f8457" (UID: "c5c516fb-b637-43d1-863e-0916ad4f8457"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:34.932487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.932306    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-credential-socket" pod "c5c516fb-b637-43d1-863e-0916ad4f8457" (UID: "c5c516fb-b637-43d1-863e-0916ad4f8457"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:34.932980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.932643    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-socket" pod "c5c516fb-b637-43d1-863e-0916ad4f8457" (UID: "c5c516fb-b637-43d1-863e-0916ad4f8457"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:34.942061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.942027    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-podinfo" pod "c5c516fb-b637-43d1-863e-0916ad4f8457" (UID: "c5c516fb-b637-43d1-863e-0916ad4f8457"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:34.946092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.946051    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-envoy" pod "c5c516fb-b637-43d1-863e-0916ad4f8457" (UID: "c5c516fb-b637-43d1-863e-0916ad4f8457"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:34.947282 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.947214    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-token" pod "c5c516fb-b637-43d1-863e-0916ad4f8457" (UID: "c5c516fb-b637-43d1-863e-0916ad4f8457"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:34.949293 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.949266    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-kube-api-access-ff88r" pod "c5c516fb-b637-43d1-863e-0916ad4f8457" (UID: "c5c516fb-b637-43d1-863e-0916ad4f8457"). InnerVolumeSpecName "kube-api-access-ff88r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.987609    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-envoy\") pod \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") "
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.987678    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-certs\") pod \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") "
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.987733    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-podinfo\") pod \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") "
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.987778    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istiod-ca-cert\") pod \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") "
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.987808    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-socket\") pod \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") "
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.987833    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-kube-api-access-74h9v\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-kube-api-access-74h9v\") pod \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") "
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.987950    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-token\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-token\") pod \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") "
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.987979    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-data\") pod \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") "
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988033    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-credential-socket\") pod \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\" (UID: \"0d46ac1c-71c4-4f3c-af7e-f4de12cee963\") "
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988424    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988437    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988447    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988460    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988469    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988477    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ff88r\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-kube-api-access-ff88r\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988486    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988496    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5c516fb-b637-43d1-863e-0916ad4f8457-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.988703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988504    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5c516fb-b637-43d1-863e-0916ad4f8457-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:34.989599 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.988999    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-credential-socket" pod "0d46ac1c-71c4-4f3c-af7e-f4de12cee963" (UID: "0d46ac1c-71c4-4f3c-af7e-f4de12cee963"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:34.992315 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.991985    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-envoy" pod "0d46ac1c-71c4-4f3c-af7e-f4de12cee963" (UID: "0d46ac1c-71c4-4f3c-af7e-f4de12cee963"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:34.992684 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.992650    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-socket" pod "0d46ac1c-71c4-4f3c-af7e-f4de12cee963" (UID: "0d46ac1c-71c4-4f3c-af7e-f4de12cee963"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:34.993051 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.993026    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istiod-ca-cert" pod "0d46ac1c-71c4-4f3c-af7e-f4de12cee963" (UID: "0d46ac1c-71c4-4f3c-af7e-f4de12cee963"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:34.993546 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.993520    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-certs" pod "0d46ac1c-71c4-4f3c-af7e-f4de12cee963" (UID: "0d46ac1c-71c4-4f3c-af7e-f4de12cee963"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:34.998023 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:34.998000    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-data" pod "0d46ac1c-71c4-4f3c-af7e-f4de12cee963" (UID: "0d46ac1c-71c4-4f3c-af7e-f4de12cee963"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:35.009589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.009523    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-kube-api-access-74h9v" pod "0d46ac1c-71c4-4f3c-af7e-f4de12cee963" (UID: "0d46ac1c-71c4-4f3c-af7e-f4de12cee963"). InnerVolumeSpecName "kube-api-access-74h9v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:35.010191 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.010168    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-podinfo" pod "0d46ac1c-71c4-4f3c-af7e-f4de12cee963" (UID: "0d46ac1c-71c4-4f3c-af7e-f4de12cee963"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:35.011988 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.011956    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-token" pod "0d46ac1c-71c4-4f3c-af7e-f4de12cee963" (UID: "0d46ac1c-71c4-4f3c-af7e-f4de12cee963"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:35.064742 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.064333    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:35.067606 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.067572    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:45:35.096383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.096338    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.096383 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.096382    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.096658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.096400    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.096658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.096412    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.096658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.096427    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.096658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.096441    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.096658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.096455    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74h9v\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-kube-api-access-74h9v\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.096658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.096470    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.096658 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.096483    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d46ac1c-71c4-4f3c-af7e-f4de12cee963-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.197508    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-socket\") pod \"748b63d2-2388-42ce-b73f-ecd48db35002\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") "
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.197620    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/748b63d2-2388-42ce-b73f-ecd48db35002-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748b63d2-2388-42ce-b73f-ecd48db35002-istiod-ca-cert\") pod \"748b63d2-2388-42ce-b73f-ecd48db35002\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") "
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.197724    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-data\") pod \"748b63d2-2388-42ce-b73f-ecd48db35002\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") "
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.197764    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-credential-socket\") pod \"748b63d2-2388-42ce-b73f-ecd48db35002\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") "
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.197881    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/748b63d2-2388-42ce-b73f-ecd48db35002-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748b63d2-2388-42ce-b73f-ecd48db35002-istio-podinfo\") pod \"748b63d2-2388-42ce-b73f-ecd48db35002\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") "
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.197947    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-istio-token\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-istio-token\") pod \"748b63d2-2388-42ce-b73f-ecd48db35002\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") "
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.197991    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-certs\") pod \"748b63d2-2388-42ce-b73f-ecd48db35002\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") "
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.198009    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-socket" pod "748b63d2-2388-42ce-b73f-ecd48db35002" (UID: "748b63d2-2388-42ce-b73f-ecd48db35002"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.198023    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-kube-api-access-qbnbh\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-kube-api-access-qbnbh\") pod \"748b63d2-2388-42ce-b73f-ecd48db35002\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") "
Oct 31 07:45:35.198473 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.198091    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-envoy\") pod \"748b63d2-2388-42ce-b73f-ecd48db35002\" (UID: \"748b63d2-2388-42ce-b73f-ecd48db35002\") "
Oct 31 07:45:35.204271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.198764    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/748b63d2-2388-42ce-b73f-ecd48db35002-istiod-ca-cert" pod "748b63d2-2388-42ce-b73f-ecd48db35002" (UID: "748b63d2-2388-42ce-b73f-ecd48db35002"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:35.204271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.199063    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-certs" pod "748b63d2-2388-42ce-b73f-ecd48db35002" (UID: "748b63d2-2388-42ce-b73f-ecd48db35002"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:35.204271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.199887    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-data" pod "748b63d2-2388-42ce-b73f-ecd48db35002" (UID: "748b63d2-2388-42ce-b73f-ecd48db35002"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:35.204271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.200264    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-credential-socket" pod "748b63d2-2388-42ce-b73f-ecd48db35002" (UID: "748b63d2-2388-42ce-b73f-ecd48db35002"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:35.204271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.201328    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.204271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.201352    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.204271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.201365    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/748b63d2-2388-42ce-b73f-ecd48db35002-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.204271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.201379    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.204271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.201392    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.205615 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.205579    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-envoy" pod "748b63d2-2388-42ce-b73f-ecd48db35002" (UID: "748b63d2-2388-42ce-b73f-ecd48db35002"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:35.231327 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.225834    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-kube-api-access-qbnbh" pod "748b63d2-2388-42ce-b73f-ecd48db35002" (UID: "748b63d2-2388-42ce-b73f-ecd48db35002"). InnerVolumeSpecName "kube-api-access-qbnbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:35.242199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.233775    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-istio-token" pod "748b63d2-2388-42ce-b73f-ecd48db35002" (UID: "748b63d2-2388-42ce-b73f-ecd48db35002"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:35.242199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.241990    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/748b63d2-2388-42ce-b73f-ecd48db35002-istio-podinfo" pod "748b63d2-2388-42ce-b73f-ecd48db35002" (UID: "748b63d2-2388-42ce-b73f-ecd48db35002"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:35.302785 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.302744    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/748b63d2-2388-42ce-b73f-ecd48db35002-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.302785 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.302786    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.302992 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.302801    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbnbh\" (UniqueName: \"kubernetes.io/projected/748b63d2-2388-42ce-b73f-ecd48db35002-kube-api-access-qbnbh\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.302992 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.302815    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/748b63d2-2388-42ce-b73f-ecd48db35002-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:35.461074 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.461035    5039 generic.go:356] "Generic (PLEG): container finished" podID="748b63d2-2388-42ce-b73f-ecd48db35002" containerID="c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c" exitCode=0
Oct 31 07:45:35.461524 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.461142    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"
Oct 31 07:45:35.461524 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.461148    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" event={"ID":"748b63d2-2388-42ce-b73f-ecd48db35002","Type":"ContainerDied","Data":"c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c"}
Oct 31 07:45:35.461524 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.461208    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q" event={"ID":"748b63d2-2388-42ce-b73f-ecd48db35002","Type":"ContainerDied","Data":"6b75484f645dca2a6c326a238981696b30d9a8b4a17fa516d5ce6bc345bbd608"}
Oct 31 07:45:35.461524 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.461238    5039 scope.go:122] "RemoveContainer" containerID="c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c"
Oct 31 07:45:35.464979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.464945    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt" event={"ID":"0d46ac1c-71c4-4f3c-af7e-f4de12cee963","Type":"ContainerDied","Data":"a54249ff5b12085cbc44d82ae2c55ff2c97cfdf8b2bfe61b6050fc90c0655b3b"}
Oct 31 07:45:35.465107 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.465011    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"
Oct 31 07:45:35.469287 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.469260    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"
Oct 31 07:45:35.469398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.469324    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6" event={"ID":"c5c516fb-b637-43d1-863e-0916ad4f8457","Type":"ContainerDied","Data":"d1fcd6bbac8e3e689177002dbd80e722a36638988cab389f68cdb4d0b79dbd00"}
Oct 31 07:45:35.474806 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.474778    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:35.479378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.479354    5039 scope.go:122] "RemoveContainer" containerID="c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c"
Oct 31 07:45:35.479739 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:35.479703    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c\": container with ID starting with c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c not found: ID does not exist" containerID="c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c"
Oct 31 07:45:35.479872 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.479742    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c"} err="failed to get container status \"c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c\": rpc error: code = NotFound desc = could not find container \"c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c\": container with ID starting with c74465f7e4cf149e6f01a0aa1c61e92a80ae147e8a59b7a5de3c609e3d65d95c not found: ID does not exist"
Oct 31 07:45:35.479872 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.479775    5039 scope.go:122] "RemoveContainer" containerID="82436e6e5ad508c1ac90b2e26450f959054891527a8af17adfe06f88e551524f"
Oct 31 07:45:35.492364 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.492344    5039 scope.go:122] "RemoveContainer" containerID="194ec64d4fcd2b522d3a9959990b03e28be0e16393793215fb667bc34cc8f3b6"
Oct 31 07:45:35.591224 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.591185    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"]
Oct 31 07:45:35.597953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.597905    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-jd28q"]
Oct 31 07:45:35.617134 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.617099    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" path="/var/lib/kubelet/pods/748b63d2-2388-42ce-b73f-ecd48db35002/volumes"
Oct 31 07:45:35.617538 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.617521    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ec6f58c-cc28-4dd8-b87f-03085f51a69c" path="/var/lib/kubelet/pods/9ec6f58c-cc28-4dd8-b87f-03085f51a69c/volumes"
Oct 31 07:45:35.630260 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.630224    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"]
Oct 31 07:45:35.635687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.635662    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-rz2l6"]
Oct 31 07:45:35.688318 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.688284    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"]
Oct 31 07:45:35.691640 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.691612    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-b1fda4-openshift-default-c9c5b7f4c-6cngt"]
Oct 31 07:45:35.918325 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.918222    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"]
Oct 31 07:45:35.918808 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.918771    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8" podUID="3e5976e4-eb9b-4e52-b602-196cafb8d10b" containerName="maas-api" containerID="cri-o://105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8" gracePeriod=30
Oct 31 07:45:35.979283 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:35.979248    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:36.505982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.505948    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:36.510169 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.509145    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:45:36.516324 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.516282    5039 generic.go:356] "Generic (PLEG): container finished" podID="3e5976e4-eb9b-4e52-b602-196cafb8d10b" containerID="105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8" exitCode=0
Oct 31 07:45:36.517188 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.516580    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8" event={"ID":"3e5976e4-eb9b-4e52-b602-196cafb8d10b","Type":"ContainerDied","Data":"105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8"}
Oct 31 07:45:36.517347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.517331    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8" event={"ID":"3e5976e4-eb9b-4e52-b602-196cafb8d10b","Type":"ContainerDied","Data":"2dacc38a8396c29afdcb22a981f7ff926ab7a7d5707ee7238209205684aa7d65"}
Oct 31 07:45:36.517471 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.517457    5039 scope.go:122] "RemoveContainer" containerID="105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8"
Oct 31 07:45:36.517626 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.516718    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"
Oct 31 07:45:36.542137 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.539176    5039 scope.go:122] "RemoveContainer" containerID="105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8"
Oct 31 07:45:36.542137 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:36.539538    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8\": container with ID starting with 105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8 not found: ID does not exist" containerID="105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8"
Oct 31 07:45:36.542137 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.539596    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8"} err="failed to get container status \"105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8\": rpc error: code = NotFound desc = could not find container \"105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8\": container with ID starting with 105a021db573cc8e349c2ce5399a52cd535b7b9482a7dd62efbf4cad2eaea0a8 not found: ID does not exist"
Oct 31 07:45:36.603973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.598767    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-metrics-certs\") pod \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") "
Oct 31 07:45:36.603973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.598888    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3e5976e4-eb9b-4e52-b602-196cafb8d10b-kube-api-access-fpgqq\" (UniqueName: \"kubernetes.io/projected/3e5976e4-eb9b-4e52-b602-196cafb8d10b-kube-api-access-fpgqq\") pod \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") "
Oct 31 07:45:36.603973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.598938    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-maas-api-tls\") pod \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") "
Oct 31 07:45:36.603973 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.599046    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3e5976e4-eb9b-4e52-b602-196cafb8d10b-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5976e4-eb9b-4e52-b602-196cafb8d10b-openshift-service-ca\") pod \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\" (UID: \"3e5976e4-eb9b-4e52-b602-196cafb8d10b\") "
Oct 31 07:45:36.620202 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.620166    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e5976e4-eb9b-4e52-b602-196cafb8d10b-openshift-service-ca" pod "3e5976e4-eb9b-4e52-b602-196cafb8d10b" (UID: "3e5976e4-eb9b-4e52-b602-196cafb8d10b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:36.621161 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.621132    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e5976e4-eb9b-4e52-b602-196cafb8d10b-kube-api-access-fpgqq" pod "3e5976e4-eb9b-4e52-b602-196cafb8d10b" (UID: "3e5976e4-eb9b-4e52-b602-196cafb8d10b"). InnerVolumeSpecName "kube-api-access-fpgqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:36.645571 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.645535    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-maas-api-tls" pod "3e5976e4-eb9b-4e52-b602-196cafb8d10b" (UID: "3e5976e4-eb9b-4e52-b602-196cafb8d10b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:36.658224 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.658135    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-metrics-certs" pod "3e5976e4-eb9b-4e52-b602-196cafb8d10b" (UID: "3e5976e4-eb9b-4e52-b602-196cafb8d10b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:36.701167 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.701083    5039 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e5976e4-eb9b-4e52-b602-196cafb8d10b-openshift-service-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:36.701167 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.701118    5039 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-metrics-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:36.701167 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.701136    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpgqq\" (UniqueName: \"kubernetes.io/projected/3e5976e4-eb9b-4e52-b602-196cafb8d10b-kube-api-access-fpgqq\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:36.701167 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.701149    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e5976e4-eb9b-4e52-b602-196cafb8d10b-maas-api-tls\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:36.706477 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.706440    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:36.885537 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.885508    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"]
Oct 31 07:45:36.888814 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.888780    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-3dff3f-b8fd9f475-5f2g8"]
Oct 31 07:45:36.943572 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:36.943441    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:37.306999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.306957    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:37.488599 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.488551    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"]
Oct 31 07:45:37.494100 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.494047    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w3-3cc201-kzh82"]
Oct 31 07:45:37.509547 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.509509    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:37.624182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.624054    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" path="/var/lib/kubelet/pods/0d46ac1c-71c4-4f3c-af7e-f4de12cee963/volumes"
Oct 31 07:45:37.624805 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.624777    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0db205e5-99fe-4bb0-9957-43514551830f" path="/var/lib/kubelet/pods/0db205e5-99fe-4bb0-9957-43514551830f/volumes"
Oct 31 07:45:37.625395 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.625375    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3e5976e4-eb9b-4e52-b602-196cafb8d10b" path="/var/lib/kubelet/pods/3e5976e4-eb9b-4e52-b602-196cafb8d10b/volumes"
Oct 31 07:45:37.626465 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.626440    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" path="/var/lib/kubelet/pods/c5c516fb-b637-43d1-863e-0916ad4f8457/volumes"
Oct 31 07:45:37.735957 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.734374    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:37.947070 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:37.943147    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:38.933940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:38.931014    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:39.188930 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.188730    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:39.525539 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.525488    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:39.615187 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.615075    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c" podUID="d0b234c3-44e8-4a22-96a3-c758c7cb8af4" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.680313    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"]
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681215    5039 cpu_manager.go:414] "containerMap: removing container" podUID="9ec6f58c-cc28-4dd8-b87f-03085f51a69c" containerName="payload-pre-processing"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681239    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ec6f58c-cc28-4dd8-b87f-03085f51a69c" containerName="payload-pre-processing"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681265    5039 cpu_manager.go:414] "containerMap: removing container" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681274    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681304    5039 cpu_manager.go:414] "containerMap: removing container" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681312    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681331    5039 cpu_manager.go:414] "containerMap: removing container" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681339    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681367    5039 cpu_manager.go:414] "containerMap: removing container" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerName="istio-proxy"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681375    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerName="istio-proxy"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681385    5039 cpu_manager.go:414] "containerMap: removing container" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681391    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681404    5039 cpu_manager.go:414] "containerMap: removing container" podUID="3e5976e4-eb9b-4e52-b602-196cafb8d10b" containerName="maas-api"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681411    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3e5976e4-eb9b-4e52-b602-196cafb8d10b" containerName="maas-api"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681426    5039 cpu_manager.go:414] "containerMap: removing container" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681434    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681454    5039 cpu_manager.go:414] "containerMap: removing container" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681461    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681473    5039 cpu_manager.go:414] "containerMap: removing container" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681480    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681493    5039 cpu_manager.go:414] "containerMap: removing container" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681500    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681513    5039 cpu_manager.go:414] "containerMap: removing container" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681520    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681533    5039 cpu_manager.go:414] "containerMap: removing container" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681541    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681669    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681681    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="c5c516fb-b637-43d1-863e-0916ad4f8457" containerName="istio-proxy"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681694    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="748b63d2-2388-42ce-b73f-ecd48db35002" containerName="istio-proxy"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681705    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="3e5976e4-eb9b-4e52-b602-196cafb8d10b" containerName="maas-api"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681718    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681731    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681741    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="7eccebf7-2bb0-4a5b-8ac6-4e7b04a6e5b2" containerName="main"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681752    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="0d46ac1c-71c4-4f3c-af7e-f4de12cee963" containerName="istio-proxy"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681760    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681770    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681778    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerName="cleanup"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.681789    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ec6f58c-cc28-4dd8-b87f-03085f51a69c" containerName="payload-pre-processing"
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.688248    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"]
Oct 31 07:45:39.689938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.688366    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:39.732377 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.727104    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:45:39.745940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.741121    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:45:39.830819 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.830649    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf7bf\" (UniqueName: \"kubernetes.io/projected/b52efd47-605f-4417-bb71-9b59bcfb9cd9-kube-api-access-lf7bf\") pod \"maas-api-revoke-sub-a131f47a-mltx2\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:39.830819 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.830778    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a131f47a-mltx2\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:39.831087 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.830849    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a131f47a-mltx2\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:39.918559 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.918507    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:39.932232 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.932199    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a131f47a-mltx2\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:39.932411 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.932293    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a131f47a-mltx2\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:39.932489 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.932415    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf7bf\" (UniqueName: \"kubernetes.io/projected/b52efd47-605f-4417-bb71-9b59bcfb9cd9-kube-api-access-lf7bf\") pod \"maas-api-revoke-sub-a131f47a-mltx2\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:39.933045 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.933023    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a131f47a-mltx2\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:39.935108 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.935081    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a131f47a-mltx2\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:39.951655 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:39.951622    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf7bf\" (UniqueName: \"kubernetes.io/projected/b52efd47-605f-4417-bb71-9b59bcfb9cd9-kube-api-access-lf7bf\") pod \"maas-api-revoke-sub-a131f47a-mltx2\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:40.064586 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.064549    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:40.122222 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.122176    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:40.143977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.143942    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"]
Oct 31 07:45:40.144582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.144562    5039 cpu_manager.go:414] "containerMap: removing container" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerName="cleanup"
Oct 31 07:45:40.144669 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.144583    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerName="cleanup"
Oct 31 07:45:40.144669 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.144617    5039 cpu_manager.go:414] "containerMap: removing container" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" containerName="cleanup"
Oct 31 07:45:40.144669 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.144625    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" containerName="cleanup"
Oct 31 07:45:40.144834 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.144804    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4e33cdb-b0ab-4b0e-9ec0-1d97c83bd5da" containerName="cleanup"
Oct 31 07:45:40.144834 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.144817    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="5768b5e5-af88-42c7-8784-057cc0280a2b" containerName="cleanup"
Oct 31 07:45:40.144967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.144836    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="50bdd918-5e8c-4701-b088-e29fce34b180" containerName="cleanup"
Oct 31 07:45:40.187951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.187260    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"]
Oct 31 07:45:40.187951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.187387    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.241958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.241902    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f48b9cf3-z9vq4\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.242141 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.242079    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v89kb\" (UniqueName: \"kubernetes.io/projected/db390f27-f119-44ef-8baf-33dc7a1e6a3d-kube-api-access-v89kb\") pod \"maas-api-revoke-sub-f48b9cf3-z9vq4\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.242190 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.242147    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f48b9cf3-z9vq4\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.343512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.343413    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v89kb\" (UniqueName: \"kubernetes.io/projected/db390f27-f119-44ef-8baf-33dc7a1e6a3d-kube-api-access-v89kb\") pod \"maas-api-revoke-sub-f48b9cf3-z9vq4\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.343512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.343509    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f48b9cf3-z9vq4\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.343710 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.343634    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f48b9cf3-z9vq4\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.344323 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.344291    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f48b9cf3-z9vq4\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.346368 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.346342    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f48b9cf3-z9vq4\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.361293 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.361259    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v89kb\" (UniqueName: \"kubernetes.io/projected/db390f27-f119-44ef-8baf-33dc7a1e6a3d-kube-api-access-v89kb\") pod \"maas-api-revoke-sub-f48b9cf3-z9vq4\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.371384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.371356    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:40.388652 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.388400    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"]
Oct 31 07:45:40.391683 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:45:40.391655    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb52efd47_605f_4417_bb71_9b59bcfb9cd9.slice/crio-ffb0549fd0e93cb023d9bcb0f8d594f58cd726a4a1b62601f81b0093892ada96 WatchSource:0}: Error finding container ffb0549fd0e93cb023d9bcb0f8d594f58cd726a4a1b62601f81b0093892ada96: Status 404 returned error can't find the container with id ffb0549fd0e93cb023d9bcb0f8d594f58cd726a4a1b62601f81b0093892ada96
Oct 31 07:45:40.509293 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.509243    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:40.629967 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.628713    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2" event={"ID":"b52efd47-605f-4417-bb71-9b59bcfb9cd9","Type":"ContainerStarted","Data":"ffb0549fd0e93cb023d9bcb0f8d594f58cd726a4a1b62601f81b0093892ada96"}
Oct 31 07:45:40.834835 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:40.834797    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"]
Oct 31 07:45:40.837974 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:45:40.837944    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb390f27_f119_44ef_8baf_33dc7a1e6a3d.slice/crio-8ef528fc70a12ee9de3ba22d51428670541735c551309fa77bcf0bf5230c8d7c WatchSource:0}: Error finding container 8ef528fc70a12ee9de3ba22d51428670541735c551309fa77bcf0bf5230c8d7c: Status 404 returned error can't find the container with id 8ef528fc70a12ee9de3ba22d51428670541735c551309fa77bcf0bf5230c8d7c
Oct 31 07:45:41.637680 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:41.637642    5039 generic.go:356] "Generic (PLEG): container finished" podID="b52efd47-605f-4417-bb71-9b59bcfb9cd9" containerID="9abd809bcf2b9e5d103600167f4633eb38f332f9b95a8eb17b601b4800e55cf0" exitCode=0
Oct 31 07:45:41.638188 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:41.637731    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2" event={"ID":"b52efd47-605f-4417-bb71-9b59bcfb9cd9","Type":"ContainerDied","Data":"9abd809bcf2b9e5d103600167f4633eb38f332f9b95a8eb17b601b4800e55cf0"}
Oct 31 07:45:41.639680 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:41.639653    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4" event={"ID":"db390f27-f119-44ef-8baf-33dc7a1e6a3d","Type":"ContainerStarted","Data":"92fa690219ae3ea7cf5485b1fa1fe9a15e5dc0aca62b062c4c0ae854c6aa54dc"}
Oct 31 07:45:41.639802 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:41.639705    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4" event={"ID":"db390f27-f119-44ef-8baf-33dc7a1e6a3d","Type":"ContainerStarted","Data":"8ef528fc70a12ee9de3ba22d51428670541735c551309fa77bcf0bf5230c8d7c"}
Oct 31 07:45:41.712683 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:41.712624    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4" podStartSLOduration=1.7126102410000001 podStartE2EDuration="1.712610241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:45:41.708183288 +0000 UTC m=+1056.237377962" watchObservedRunningTime="2026-10-31 07:45:41.712610241 +0000 UTC m=+1056.241804968"
Oct 31 07:45:41.919990 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:41.919852    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:42.648705 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.648664    5039 generic.go:356] "Generic (PLEG): container finished" podID="db390f27-f119-44ef-8baf-33dc7a1e6a3d" containerID="92fa690219ae3ea7cf5485b1fa1fe9a15e5dc0aca62b062c4c0ae854c6aa54dc" exitCode=0
Oct 31 07:45:42.649200 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.648742    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4" event={"ID":"db390f27-f119-44ef-8baf-33dc7a1e6a3d","Type":"ContainerDied","Data":"92fa690219ae3ea7cf5485b1fa1fe9a15e5dc0aca62b062c4c0ae854c6aa54dc"}
Oct 31 07:45:42.822230 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.822198    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:42.878703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.878625    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-openshift-ca\") pod \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") "
Oct 31 07:45:42.878901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.878840    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b52efd47-605f-4417-bb71-9b59bcfb9cd9-kube-api-access-lf7bf\" (UniqueName: \"kubernetes.io/projected/b52efd47-605f-4417-bb71-9b59bcfb9cd9-kube-api-access-lf7bf\") pod \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") "
Oct 31 07:45:42.878901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.878885    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-xks-ca\") pod \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\" (UID: \"b52efd47-605f-4417-bb71-9b59bcfb9cd9\") "
Oct 31 07:45:42.879109 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.879080    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-openshift-ca" pod "b52efd47-605f-4417-bb71-9b59bcfb9cd9" (UID: "b52efd47-605f-4417-bb71-9b59bcfb9cd9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:42.879664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.879639    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:42.881345 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.881310    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b52efd47-605f-4417-bb71-9b59bcfb9cd9-kube-api-access-lf7bf" pod "b52efd47-605f-4417-bb71-9b59bcfb9cd9" (UID: "b52efd47-605f-4417-bb71-9b59bcfb9cd9"). InnerVolumeSpecName "kube-api-access-lf7bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:42.881434 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.881343    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-xks-ca" pod "b52efd47-605f-4417-bb71-9b59bcfb9cd9" (UID: "b52efd47-605f-4417-bb71-9b59bcfb9cd9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:42.980659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.980621    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf7bf\" (UniqueName: \"kubernetes.io/projected/b52efd47-605f-4417-bb71-9b59bcfb9cd9-kube-api-access-lf7bf\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:42.980659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:42.980655    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/b52efd47-605f-4417-bb71-9b59bcfb9cd9-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:43.194608 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.194573    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:43.399943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.399836    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:43.510940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.510731    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"]
Oct 31 07:45:43.511395 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.511358    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy" containerID="cri-o://9ac2fd0a101f37400172a25f5b8462db7fe306594efcea537d194fea37420e0d" gracePeriod=30
Oct 31 07:45:43.520237 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.520195    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"]
Oct 31 07:45:43.520466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.520440    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy" containerID="cri-o://32b830d82a1d78179bc2d8c17aca5c334d83d9d40e8dd28665e285c007c1bdaa" gracePeriod=30
Oct 31 07:45:43.525936 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.525835    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"]
Oct 31 07:45:43.528552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.526074    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy" containerID="cri-o://4573654de93764db060db7787208962636a4f32cb57b0e6d7830350d66b47a3e" gracePeriod=30
Oct 31 07:45:43.535124 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.535094    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"]
Oct 31 07:45:43.535341 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.535317    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy" containerID="cri-o://a98efa9df7974f5ae6c16aebdf1da38cc75dffb93be17bb841ef7f667e28db28" gracePeriod=30
Oct 31 07:45:43.610890 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.610856    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:43.671631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.664621    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"
Oct 31 07:45:43.671631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.665326    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2" event={"ID":"b52efd47-605f-4417-bb71-9b59bcfb9cd9","Type":"ContainerDied","Data":"ffb0549fd0e93cb023d9bcb0f8d594f58cd726a4a1b62601f81b0093892ada96"}
Oct 31 07:45:43.671631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.665373    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffb0549fd0e93cb023d9bcb0f8d594f58cd726a4a1b62601f81b0093892ada96"
Oct 31 07:45:43.909964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.909903    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:43.999196 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.999159    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-openshift-ca\") pod \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") "
Oct 31 07:45:43.999406 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.999278    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db390f27-f119-44ef-8baf-33dc7a1e6a3d-kube-api-access-v89kb\" (UniqueName: \"kubernetes.io/projected/db390f27-f119-44ef-8baf-33dc7a1e6a3d-kube-api-access-v89kb\") pod \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") "
Oct 31 07:45:43.999406 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.999382    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-xks-ca\") pod \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\" (UID: \"db390f27-f119-44ef-8baf-33dc7a1e6a3d\") "
Oct 31 07:45:43.999534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.999512    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-openshift-ca" pod "db390f27-f119-44ef-8baf-33dc7a1e6a3d" (UID: "db390f27-f119-44ef-8baf-33dc7a1e6a3d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:43.999859 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:43.999841    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:44.001505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.001475    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-xks-ca" pod "db390f27-f119-44ef-8baf-33dc7a1e6a3d" (UID: "db390f27-f119-44ef-8baf-33dc7a1e6a3d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:44.001623 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.001504    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db390f27-f119-44ef-8baf-33dc7a1e6a3d-kube-api-access-v89kb" pod "db390f27-f119-44ef-8baf-33dc7a1e6a3d" (UID: "db390f27-f119-44ef-8baf-33dc7a1e6a3d"). InnerVolumeSpecName "kube-api-access-v89kb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:44.100713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.100681    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v89kb\" (UniqueName: \"kubernetes.io/projected/db390f27-f119-44ef-8baf-33dc7a1e6a3d-kube-api-access-v89kb\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:44.100713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.100709    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/db390f27-f119-44ef-8baf-33dc7a1e6a3d-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:44.456849 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.456817    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:44.673199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.673164    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"
Oct 31 07:45:44.673573 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.673200    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4" event={"ID":"db390f27-f119-44ef-8baf-33dc7a1e6a3d","Type":"ContainerDied","Data":"8ef528fc70a12ee9de3ba22d51428670541735c551309fa77bcf0bf5230c8d7c"}
Oct 31 07:45:44.673573 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.673248    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ef528fc70a12ee9de3ba22d51428670541735c551309fa77bcf0bf5230c8d7c"
Oct 31 07:45:44.725528 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.725441    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:44.825833 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.825793    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"]
Oct 31 07:45:44.826078 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.826047    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy" containerID="cri-o://a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a" gracePeriod=30
Oct 31 07:45:44.843403 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.843366    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"]
Oct 31 07:45:44.843719 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.843691    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy" containerID="cri-o://36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f" gracePeriod=30
Oct 31 07:45:44.850635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.850590    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"]
Oct 31 07:45:44.850904 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.850874    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy" containerID="cri-o://e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808" gracePeriod=30
Oct 31 07:45:44.988082 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:44.987979    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:45.399143 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.399059    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:45.534176 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.534122    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" containerID="cri-o://be14d711a92d36866c693a446c1a0460966db45a7df2649d14aee3a8be039d65" gracePeriod=45
Oct 31 07:45:45.683668 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.683633    5039 generic.go:356] "Generic (PLEG): container finished" podID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerID="be14d711a92d36866c693a446c1a0460966db45a7df2649d14aee3a8be039d65" exitCode=0
Oct 31 07:45:45.684186 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.683778    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" event={"ID":"23046dd8-ddf6-4eac-a359-db2a4ef5fae6","Type":"ContainerDied","Data":"be14d711a92d36866c693a446c1a0460966db45a7df2649d14aee3a8be039d65"}
Oct 31 07:45:45.748795 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.748758    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main" containerID="cri-o://ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff" gracePeriod=43
Oct 31 07:45:45.888340 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.888291    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:45:45.926470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.926387    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-dshm\") pod \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") "
Oct 31 07:45:45.926470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.926441    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-kube-api-access-qgm6b\" (UniqueName: \"kubernetes.io/projected/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-kube-api-access-qgm6b\") pod \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") "
Oct 31 07:45:45.926470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.926473    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tls-certs\" (UniqueName: \"kubernetes.io/secret/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tls-certs\") pod \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") "
Oct 31 07:45:45.926750 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.926563    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tmp-dir\") pod \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") "
Oct 31 07:45:45.926750 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.926632    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-home\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-home\") pod \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") "
Oct 31 07:45:45.926750 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.926741    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-model-cache\") pod \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\" (UID: \"23046dd8-ddf6-4eac-a359-db2a4ef5fae6\") "
Oct 31 07:45:45.926932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.926860    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tmp-dir" pod "23046dd8-ddf6-4eac-a359-db2a4ef5fae6" (UID: "23046dd8-ddf6-4eac-a359-db2a4ef5fae6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:45.927643 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.927124    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-home" pod "23046dd8-ddf6-4eac-a359-db2a4ef5fae6" (UID: "23046dd8-ddf6-4eac-a359-db2a4ef5fae6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:45.927643 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.927267    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-model-cache" pod "23046dd8-ddf6-4eac-a359-db2a4ef5fae6" (UID: "23046dd8-ddf6-4eac-a359-db2a4ef5fae6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:45.929331 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.929297    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:45.929331 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.929328    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:45.929514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.929344    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:45.929514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.929426    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-kube-api-access-qgm6b" pod "23046dd8-ddf6-4eac-a359-db2a4ef5fae6" (UID: "23046dd8-ddf6-4eac-a359-db2a4ef5fae6"). InnerVolumeSpecName "kube-api-access-qgm6b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:45.931577 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.929801    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-dshm" pod "23046dd8-ddf6-4eac-a359-db2a4ef5fae6" (UID: "23046dd8-ddf6-4eac-a359-db2a4ef5fae6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:45.931577 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:45.930295    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tls-certs" pod "23046dd8-ddf6-4eac-a359-db2a4ef5fae6" (UID: "23046dd8-ddf6-4eac-a359-db2a4ef5fae6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:46.030635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.030596    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:46.030635 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.030637    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgm6b\" (UniqueName: \"kubernetes.io/projected/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-kube-api-access-qgm6b\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:46.030852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.030652    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23046dd8-ddf6-4eac-a359-db2a4ef5fae6-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:46.043137 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.043107    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:45:46.131837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.131799    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-home\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-home\") pod \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") "
Oct 31 07:45:46.131837 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.131841    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-model-cache\") pod \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") "
Oct 31 07:45:46.132121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.131948    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tls-certs\" (UniqueName: \"kubernetes.io/secret/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tls-certs\") pod \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") "
Oct 31 07:45:46.132121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.131998    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tmp-dir\") pod \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") "
Oct 31 07:45:46.132121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.132031    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-dshm\") pod \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") "
Oct 31 07:45:46.132297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.132221    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-kube-api-access-k5sqc\" (UniqueName: \"kubernetes.io/projected/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-kube-api-access-k5sqc\") pod \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\" (UID: \"bd344b65-691d-401a-b1af-6c0dd8ae8b7f\") "
Oct 31 07:45:46.132297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.132256    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-model-cache" pod "bd344b65-691d-401a-b1af-6c0dd8ae8b7f" (UID: "bd344b65-691d-401a-b1af-6c0dd8ae8b7f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:46.132297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.132268    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tmp-dir" pod "bd344b65-691d-401a-b1af-6c0dd8ae8b7f" (UID: "bd344b65-691d-401a-b1af-6c0dd8ae8b7f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:46.132948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.132900    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:46.132948 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.132945    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:46.133121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.133015    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-home" pod "bd344b65-691d-401a-b1af-6c0dd8ae8b7f" (UID: "bd344b65-691d-401a-b1af-6c0dd8ae8b7f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:46.134271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.134245    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-dshm" pod "bd344b65-691d-401a-b1af-6c0dd8ae8b7f" (UID: "bd344b65-691d-401a-b1af-6c0dd8ae8b7f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:46.134647 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.134623    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tls-certs" pod "bd344b65-691d-401a-b1af-6c0dd8ae8b7f" (UID: "bd344b65-691d-401a-b1af-6c0dd8ae8b7f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:46.134725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.134663    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-kube-api-access-k5sqc" pod "bd344b65-691d-401a-b1af-6c0dd8ae8b7f" (UID: "bd344b65-691d-401a-b1af-6c0dd8ae8b7f"). InnerVolumeSpecName "kube-api-access-k5sqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:46.234136 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.234082    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:46.234136 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.234132    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:46.234136 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.234141    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5sqc\" (UniqueName: \"kubernetes.io/projected/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-kube-api-access-k5sqc\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:46.234373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.234150    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bd344b65-691d-401a-b1af-6c0dd8ae8b7f-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:46.693152 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.693124    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"
Oct 31 07:45:46.693591 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.693159    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" event={"ID":"23046dd8-ddf6-4eac-a359-db2a4ef5fae6","Type":"ContainerDied","Data":"7cff7a6ef1ff255a5dfe12535ea6a798e9df59ec97d041c5720489251d15843a"}
Oct 31 07:45:46.693591 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.693207    5039 scope.go:122] "RemoveContainer" containerID="be14d711a92d36866c693a446c1a0460966db45a7df2649d14aee3a8be039d65"
Oct 31 07:45:46.694803 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.694776    5039 generic.go:356] "Generic (PLEG): container finished" podID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerID="ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff" exitCode=0
Oct 31 07:45:46.694953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.694814    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"
Oct 31 07:45:46.694953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.694851    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" event={"ID":"bd344b65-691d-401a-b1af-6c0dd8ae8b7f","Type":"ContainerDied","Data":"ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff"}
Oct 31 07:45:46.694953 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.694895    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22" event={"ID":"bd344b65-691d-401a-b1af-6c0dd8ae8b7f","Type":"ContainerDied","Data":"07ab9366b57a087fa8422f1d5e17844fe32e1009a6ee9ceecf15d700bd698cc7"}
Oct 31 07:45:46.704830 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.704799    5039 scope.go:122] "RemoveContainer" containerID="ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff"
Oct 31 07:45:46.714606 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.714585    5039 scope.go:122] "RemoveContainer" containerID="ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff"
Oct 31 07:45:46.714938 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:46.714902    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff\": container with ID starting with ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff not found: ID does not exist" containerID="ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff"
Oct 31 07:45:46.715012 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.714955    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff"} err="failed to get container status \"ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff\": rpc error: code = NotFound desc = could not find container \"ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff\": container with ID starting with ffd9ee981099dc79f54ff09d71cd8da2a6facb425429ba670f9522e9fc066fff not found: ID does not exist"
Oct 31 07:45:46.742796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.742760    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"]
Oct 31 07:45:46.754407 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.754377    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/simulator-w1-4794f5-kserve-74f6db5cf-rvk22"]
Oct 31 07:45:46.775548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.775518    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"]
Oct 31 07:45:46.779028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.778999    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996"]
Oct 31 07:45:46.812813 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.812710    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:46.846125 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.846078    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-4794f5/distinct-w1-4794f5-kserve-6cd48ffbcc-lx996" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main" probeResult="failure" output="Get \"https://10.132.0.87:8000/ready\": context deadline exceeded"
Oct 31 07:45:47.000021 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:46.999990    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:47.617181 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:47.617142    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" path="/var/lib/kubelet/pods/23046dd8-ddf6-4eac-a359-db2a4ef5fae6/volumes"
Oct 31 07:45:47.617706 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:47.617688    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" path="/var/lib/kubelet/pods/bd344b65-691d-401a-b1af-6c0dd8ae8b7f/volumes"
Oct 31 07:45:48.240012 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.239982    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:45:48.360388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.360283    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-kube-api-access-x7g5x\" (UniqueName: \"kubernetes.io/projected/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-kube-api-access-x7g5x\") pod \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\" (UID: \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\") "
Oct 31 07:45:48.360388 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.360329    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-plugins-config-volume\") pod \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\" (UID: \"d0b234c3-44e8-4a22-96a3-c758c7cb8af4\") "
Oct 31 07:45:48.360804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.360774    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-plugins-config-volume" pod "d0b234c3-44e8-4a22-96a3-c758c7cb8af4" (UID: "d0b234c3-44e8-4a22-96a3-c758c7cb8af4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:48.362616 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.362585    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-kube-api-access-x7g5x" pod "d0b234c3-44e8-4a22-96a3-c758c7cb8af4" (UID: "d0b234c3-44e8-4a22-96a3-c758c7cb8af4"). InnerVolumeSpecName "kube-api-access-x7g5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:48.461738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.461691    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7g5x\" (UniqueName: \"kubernetes.io/projected/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-kube-api-access-x7g5x\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:48.461738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.461730    5039 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d0b234c3-44e8-4a22-96a3-c758c7cb8af4-plugins-config-volume\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:48.596855 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.596816    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:48.728512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.728469    5039 generic.go:356] "Generic (PLEG): container finished" podID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerID="4573654de93764db060db7787208962636a4f32cb57b0e6d7830350d66b47a3e" exitCode=0
Oct 31 07:45:48.728775 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.728699    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" event={"ID":"8025aa84-ff53-40fe-8d4f-e6a681161d24","Type":"ContainerDied","Data":"4573654de93764db060db7787208962636a4f32cb57b0e6d7830350d66b47a3e"}
Oct 31 07:45:48.731325 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.731284    5039 generic.go:356] "Generic (PLEG): container finished" podID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerID="9ac2fd0a101f37400172a25f5b8462db7fe306594efcea537d194fea37420e0d" exitCode=0
Oct 31 07:45:48.731520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.731407    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" event={"ID":"40e932f2-848b-40ca-b59d-d77bc8e6090d","Type":"ContainerDied","Data":"9ac2fd0a101f37400172a25f5b8462db7fe306594efcea537d194fea37420e0d"}
Oct 31 07:45:48.731520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.731464    5039 scope.go:122] "RemoveContainer" containerID="27fd670e8982dd4af04aee4461377b4e5da2c03cc0a12ec6b762efdd2406eaf0"
Oct 31 07:45:48.739110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.738198    5039 generic.go:356] "Generic (PLEG): container finished" podID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerID="a98efa9df7974f5ae6c16aebdf1da38cc75dffb93be17bb841ef7f667e28db28" exitCode=0
Oct 31 07:45:48.739110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.738369    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" event={"ID":"48d872d9-8044-41f9-b3ff-5a530abf893d","Type":"ContainerDied","Data":"a98efa9df7974f5ae6c16aebdf1da38cc75dffb93be17bb841ef7f667e28db28"}
Oct 31 07:45:48.741957 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.741034    5039 generic.go:356] "Generic (PLEG): container finished" podID="bc664199-a36b-4404-9308-ef77ec4b2656" containerID="32b830d82a1d78179bc2d8c17aca5c334d83d9d40e8dd28665e285c007c1bdaa" exitCode=0
Oct 31 07:45:48.741957 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.741157    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" event={"ID":"bc664199-a36b-4404-9308-ef77ec4b2656","Type":"ContainerDied","Data":"32b830d82a1d78179bc2d8c17aca5c334d83d9d40e8dd28665e285c007c1bdaa"}
Oct 31 07:45:48.744958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.743166    5039 generic.go:356] "Generic (PLEG): container finished" podID="d0b234c3-44e8-4a22-96a3-c758c7cb8af4" containerID="485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26" exitCode=0
Oct 31 07:45:48.744958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.743213    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c" event={"ID":"d0b234c3-44e8-4a22-96a3-c758c7cb8af4","Type":"ContainerDied","Data":"485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26"}
Oct 31 07:45:48.744958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.743258    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c" event={"ID":"d0b234c3-44e8-4a22-96a3-c758c7cb8af4","Type":"ContainerDied","Data":"3d419180ac12007eafe0e94b3dde1aab9cb5ee6579674b845349af44e11e71af"}
Oct 31 07:45:48.744958 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.743335    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"
Oct 31 07:45:48.765951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.765843    5039 scope.go:122] "RemoveContainer" containerID="485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26"
Oct 31 07:45:48.791264 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.791123    5039 scope.go:122] "RemoveContainer" containerID="485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26"
Oct 31 07:45:48.791627 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:48.791535    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26\": container with ID starting with 485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26 not found: ID does not exist" containerID="485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26"
Oct 31 07:45:48.791627 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.791579    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26"} err="failed to get container status \"485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26\": rpc error: code = NotFound desc = could not find container \"485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26\": container with ID starting with 485462ea20745e00e78715aaf09898f8be61b06742ebd15aab336ad9209d3c26 not found: ID does not exist"
Oct 31 07:45:48.816149 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.816115    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"]
Oct 31 07:45:48.843952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.841727    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w3-3cc201-7b6c8f8b7f-hqm6c"]
Oct 31 07:45:48.874400 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.874371    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:45:48.966820 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.966547    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:45:48.975604 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.975577    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-kube-api-access-bx8lb\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-kube-api-access-bx8lb\") pod \"bc664199-a36b-4404-9308-ef77ec4b2656\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") "
Oct 31 07:45:48.975787 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.975681    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bc664199-a36b-4404-9308-ef77ec4b2656-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc664199-a36b-4404-9308-ef77ec4b2656-istiod-ca-cert\") pod \"bc664199-a36b-4404-9308-ef77ec4b2656\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") "
Oct 31 07:45:48.975861 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.975791    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-data\") pod \"bc664199-a36b-4404-9308-ef77ec4b2656\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") "
Oct 31 07:45:48.975861 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.975846    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/bc664199-a36b-4404-9308-ef77ec4b2656-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc664199-a36b-4404-9308-ef77ec4b2656-istio-podinfo\") pod \"bc664199-a36b-4404-9308-ef77ec4b2656\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") "
Oct 31 07:45:48.975994 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.975886    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-credential-socket\") pod \"bc664199-a36b-4404-9308-ef77ec4b2656\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") "
Oct 31 07:45:48.976054 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.976010    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-socket\") pod \"bc664199-a36b-4404-9308-ef77ec4b2656\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") "
Oct 31 07:45:48.976109 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.976096    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-certs\") pod \"bc664199-a36b-4404-9308-ef77ec4b2656\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") "
Oct 31 07:45:48.976159 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.976149    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-envoy\") pod \"bc664199-a36b-4404-9308-ef77ec4b2656\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") "
Oct 31 07:45:48.976215 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.976180    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-istio-token\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-istio-token\") pod \"bc664199-a36b-4404-9308-ef77ec4b2656\" (UID: \"bc664199-a36b-4404-9308-ef77ec4b2656\") "
Oct 31 07:45:48.976271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.976230    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:48.976672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.976513    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-socket" pod "bc664199-a36b-4404-9308-ef77ec4b2656" (UID: "bc664199-a36b-4404-9308-ef77ec4b2656"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:48.976672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.976608    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-credential-socket" pod "bc664199-a36b-4404-9308-ef77ec4b2656" (UID: "bc664199-a36b-4404-9308-ef77ec4b2656"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:48.976672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.976629    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-certs" pod "bc664199-a36b-4404-9308-ef77ec4b2656" (UID: "bc664199-a36b-4404-9308-ef77ec4b2656"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:48.977027 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.976959    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-data" pod "bc664199-a36b-4404-9308-ef77ec4b2656" (UID: "bc664199-a36b-4404-9308-ef77ec4b2656"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:48.977118 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.977069    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:48.977118 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.977107    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:48.977118 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.977106    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc664199-a36b-4404-9308-ef77ec4b2656-istiod-ca-cert" pod "bc664199-a36b-4404-9308-ef77ec4b2656" (UID: "bc664199-a36b-4404-9308-ef77ec4b2656"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:48.977269 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.977123    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:48.978852 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.978831    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-envoy" pod "bc664199-a36b-4404-9308-ef77ec4b2656" (UID: "bc664199-a36b-4404-9308-ef77ec4b2656"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:48.979802 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.979772    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-istio-token" pod "bc664199-a36b-4404-9308-ef77ec4b2656" (UID: "bc664199-a36b-4404-9308-ef77ec4b2656"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:48.979908 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.979875    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc664199-a36b-4404-9308-ef77ec4b2656-istio-podinfo" pod "bc664199-a36b-4404-9308-ef77ec4b2656" (UID: "bc664199-a36b-4404-9308-ef77ec4b2656"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:48.980322 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.980302    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-kube-api-access-bx8lb" pod "bc664199-a36b-4404-9308-ef77ec4b2656" (UID: "bc664199-a36b-4404-9308-ef77ec4b2656"). InnerVolumeSpecName "kube-api-access-bx8lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:48.981984 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:48.981963    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078289    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-kube-api-access-gvj2z\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-kube-api-access-gvj2z\") pod \"48d872d9-8044-41f9-b3ff-5a530abf893d\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078363    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-podinfo\") pod \"8025aa84-ff53-40fe-8d4f-e6a681161d24\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078398    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-socket\") pod \"40e932f2-848b-40ca-b59d-d77bc8e6090d\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078425    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/40e932f2-848b-40ca-b59d-d77bc8e6090d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e932f2-848b-40ca-b59d-d77bc8e6090d-istiod-ca-cert\") pod \"40e932f2-848b-40ca-b59d-d77bc8e6090d\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078462    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-credential-socket\") pod \"48d872d9-8044-41f9-b3ff-5a530abf893d\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078517    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8025aa84-ff53-40fe-8d4f-e6a681161d24-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8025aa84-ff53-40fe-8d4f-e6a681161d24-istiod-ca-cert\") pod \"8025aa84-ff53-40fe-8d4f-e6a681161d24\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078545    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-token\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-token\") pod \"40e932f2-848b-40ca-b59d-d77bc8e6090d\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078585    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-certs\") pod \"48d872d9-8044-41f9-b3ff-5a530abf893d\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078625    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-envoy\") pod \"48d872d9-8044-41f9-b3ff-5a530abf893d\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078680    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-data\") pod \"8025aa84-ff53-40fe-8d4f-e6a681161d24\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078740    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/48d872d9-8044-41f9-b3ff-5a530abf893d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d872d9-8044-41f9-b3ff-5a530abf893d-istiod-ca-cert\") pod \"48d872d9-8044-41f9-b3ff-5a530abf893d\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078767    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-socket\") pod \"48d872d9-8044-41f9-b3ff-5a530abf893d\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078799    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-data\") pod \"40e932f2-848b-40ca-b59d-d77bc8e6090d\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078859    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-podinfo\") pod \"48d872d9-8044-41f9-b3ff-5a530abf893d\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") "
Oct 31 07:45:49.078952 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078937    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-socket\") pod \"8025aa84-ff53-40fe-8d4f-e6a681161d24\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.078977    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-certs\") pod \"8025aa84-ff53-40fe-8d4f-e6a681161d24\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079018    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-envoy\") pod \"40e932f2-848b-40ca-b59d-d77bc8e6090d\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079052    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-socket" pod "40e932f2-848b-40ca-b59d-d77bc8e6090d" (UID: "40e932f2-848b-40ca-b59d-d77bc8e6090d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079092    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-podinfo\") pod \"40e932f2-848b-40ca-b59d-d77bc8e6090d\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079139    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-credential-socket\") pod \"8025aa84-ff53-40fe-8d4f-e6a681161d24\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079170    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-data\") pod \"48d872d9-8044-41f9-b3ff-5a530abf893d\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079209    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-token\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-token\") pod \"8025aa84-ff53-40fe-8d4f-e6a681161d24\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079272    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-kube-api-access-tdqdg\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-kube-api-access-tdqdg\") pod \"8025aa84-ff53-40fe-8d4f-e6a681161d24\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079301    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-credential-socket\") pod \"40e932f2-848b-40ca-b59d-d77bc8e6090d\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079332    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-certs\") pod \"40e932f2-848b-40ca-b59d-d77bc8e6090d\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079390    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-kube-api-access-x9cxl\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-kube-api-access-x9cxl\") pod \"40e932f2-848b-40ca-b59d-d77bc8e6090d\" (UID: \"40e932f2-848b-40ca-b59d-d77bc8e6090d\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079435    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-envoy\") pod \"8025aa84-ff53-40fe-8d4f-e6a681161d24\" (UID: \"8025aa84-ff53-40fe-8d4f-e6a681161d24\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079465    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-token\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-token\") pod \"48d872d9-8044-41f9-b3ff-5a530abf893d\" (UID: \"48d872d9-8044-41f9-b3ff-5a530abf893d\") "
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079493    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-credential-socket" pod "48d872d9-8044-41f9-b3ff-5a530abf893d" (UID: "48d872d9-8044-41f9-b3ff-5a530abf893d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.079906    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40e932f2-848b-40ca-b59d-d77bc8e6090d-istiod-ca-cert" pod "40e932f2-848b-40ca-b59d-d77bc8e6090d" (UID: "40e932f2-848b-40ca-b59d-d77bc8e6090d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080344    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080371    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080385    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080595    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40e932f2-848b-40ca-b59d-d77bc8e6090d-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080616    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080740    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-certs" pod "48d872d9-8044-41f9-b3ff-5a530abf893d" (UID: "48d872d9-8044-41f9-b3ff-5a530abf893d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080659    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx8lb\" (UniqueName: \"kubernetes.io/projected/bc664199-a36b-4404-9308-ef77ec4b2656-kube-api-access-bx8lb\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080789    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc664199-a36b-4404-9308-ef77ec4b2656-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080807    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc664199-a36b-4404-9308-ef77ec4b2656-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.080821    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc664199-a36b-4404-9308-ef77ec4b2656-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.081309    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-data" pod "8025aa84-ff53-40fe-8d4f-e6a681161d24" (UID: "8025aa84-ff53-40fe-8d4f-e6a681161d24"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.081690    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48d872d9-8044-41f9-b3ff-5a530abf893d-istiod-ca-cert" pod "48d872d9-8044-41f9-b3ff-5a530abf893d" (UID: "48d872d9-8044-41f9-b3ff-5a530abf893d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.082062    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-socket" pod "48d872d9-8044-41f9-b3ff-5a530abf893d" (UID: "48d872d9-8044-41f9-b3ff-5a530abf893d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.082534 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.082126    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8025aa84-ff53-40fe-8d4f-e6a681161d24-istiod-ca-cert" pod "8025aa84-ff53-40fe-8d4f-e6a681161d24" (UID: "8025aa84-ff53-40fe-8d4f-e6a681161d24"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:49.084003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.082734    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-data" pod "40e932f2-848b-40ca-b59d-d77bc8e6090d" (UID: "40e932f2-848b-40ca-b59d-d77bc8e6090d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.084003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.083017    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-socket" pod "8025aa84-ff53-40fe-8d4f-e6a681161d24" (UID: "8025aa84-ff53-40fe-8d4f-e6a681161d24"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.084003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.083205    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-certs" pod "8025aa84-ff53-40fe-8d4f-e6a681161d24" (UID: "8025aa84-ff53-40fe-8d4f-e6a681161d24"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.084003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.083276    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-token" pod "48d872d9-8044-41f9-b3ff-5a530abf893d" (UID: "48d872d9-8044-41f9-b3ff-5a530abf893d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:49.084769 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.084723    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-credential-socket" pod "8025aa84-ff53-40fe-8d4f-e6a681161d24" (UID: "8025aa84-ff53-40fe-8d4f-e6a681161d24"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.084872 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.084792    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-data" pod "48d872d9-8044-41f9-b3ff-5a530abf893d" (UID: "48d872d9-8044-41f9-b3ff-5a530abf893d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.085400 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.085027    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-certs" pod "40e932f2-848b-40ca-b59d-d77bc8e6090d" (UID: "40e932f2-848b-40ca-b59d-d77bc8e6090d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.085400 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.085047    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-credential-socket" pod "40e932f2-848b-40ca-b59d-d77bc8e6090d" (UID: "40e932f2-848b-40ca-b59d-d77bc8e6090d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.085400 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.085230    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-podinfo" pod "48d872d9-8044-41f9-b3ff-5a530abf893d" (UID: "48d872d9-8044-41f9-b3ff-5a530abf893d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:49.095238 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.095211    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-kube-api-access-x9cxl" pod "40e932f2-848b-40ca-b59d-d77bc8e6090d" (UID: "40e932f2-848b-40ca-b59d-d77bc8e6090d"). InnerVolumeSpecName "kube-api-access-x9cxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:49.097420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.097179    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-podinfo" pod "40e932f2-848b-40ca-b59d-d77bc8e6090d" (UID: "40e932f2-848b-40ca-b59d-d77bc8e6090d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:49.097420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.097301    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-envoy" pod "48d872d9-8044-41f9-b3ff-5a530abf893d" (UID: "48d872d9-8044-41f9-b3ff-5a530abf893d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.097420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.097318    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-kube-api-access-gvj2z" pod "48d872d9-8044-41f9-b3ff-5a530abf893d" (UID: "48d872d9-8044-41f9-b3ff-5a530abf893d"). InnerVolumeSpecName "kube-api-access-gvj2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:49.097420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.097362    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-token" pod "40e932f2-848b-40ca-b59d-d77bc8e6090d" (UID: "40e932f2-848b-40ca-b59d-d77bc8e6090d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:49.097420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.097375    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-podinfo" pod "8025aa84-ff53-40fe-8d4f-e6a681161d24" (UID: "8025aa84-ff53-40fe-8d4f-e6a681161d24"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:49.097420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.097389    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-token" pod "8025aa84-ff53-40fe-8d4f-e6a681161d24" (UID: "8025aa84-ff53-40fe-8d4f-e6a681161d24"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:49.097420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.097405    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-kube-api-access-tdqdg" pod "8025aa84-ff53-40fe-8d4f-e6a681161d24" (UID: "8025aa84-ff53-40fe-8d4f-e6a681161d24"). InnerVolumeSpecName "kube-api-access-tdqdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:49.097716 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.097460    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-envoy" pod "40e932f2-848b-40ca-b59d-d77bc8e6090d" (UID: "40e932f2-848b-40ca-b59d-d77bc8e6090d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.098819 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.098798    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-envoy" pod "8025aa84-ff53-40fe-8d4f-e6a681161d24" (UID: "8025aa84-ff53-40fe-8d4f-e6a681161d24"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:49.182631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182599    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182626    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/48d872d9-8044-41f9-b3ff-5a530abf893d-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182636    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182645    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182656    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182666    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182673    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182684    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182693    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182700    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182710    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182719    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182727    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdqdg\" (UniqueName: \"kubernetes.io/projected/8025aa84-ff53-40fe-8d4f-e6a681161d24-kube-api-access-tdqdg\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182735    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182744    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40e932f2-848b-40ca-b59d-d77bc8e6090d-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182753    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9cxl\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-kube-api-access-x9cxl\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182761    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182769    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182777    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvj2z\" (UniqueName: \"kubernetes.io/projected/48d872d9-8044-41f9-b3ff-5a530abf893d-kube-api-access-gvj2z\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182785    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8025aa84-ff53-40fe-8d4f-e6a681161d24-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182793    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8025aa84-ff53-40fe-8d4f-e6a681161d24-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182800    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40e932f2-848b-40ca-b59d-d77bc8e6090d-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182807    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.182853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.182815    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/48d872d9-8044-41f9-b3ff-5a530abf893d-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:49.616100 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.616064    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d0b234c3-44e8-4a22-96a3-c758c7cb8af4" path="/var/lib/kubelet/pods/d0b234c3-44e8-4a22-96a3-c758c7cb8af4/volumes"
Oct 31 07:45:49.751297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.751269    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"
Oct 31 07:45:49.751502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.751296    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj" event={"ID":"40e932f2-848b-40ca-b59d-d77bc8e6090d","Type":"ContainerDied","Data":"ac9ec14976bcc12bc8bc82826e489e721d9ffcad070fdfd8208a8ce5284fd1f2"}
Oct 31 07:45:49.751502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.751353    5039 scope.go:122] "RemoveContainer" containerID="9ac2fd0a101f37400172a25f5b8462db7fe306594efcea537d194fea37420e0d"
Oct 31 07:45:49.753011 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.752983    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"
Oct 31 07:45:49.753168 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.753026    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb" event={"ID":"48d872d9-8044-41f9-b3ff-5a530abf893d","Type":"ContainerDied","Data":"17b457c2bfd4fd32022e793b9a1e9190b0a2e7e5acfa01fb5bec8010ac98a0d4"}
Oct 31 07:45:49.754835 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.754815    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"
Oct 31 07:45:49.755024 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.754855    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9" event={"ID":"bc664199-a36b-4404-9308-ef77ec4b2656","Type":"ContainerDied","Data":"3ae3896ea99af4639fe61805e38d5414fcec6987734ff0793e82a62e156df3cf"}
Oct 31 07:45:49.757804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.757778    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"
Oct 31 07:45:49.757804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.757810    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk" event={"ID":"8025aa84-ff53-40fe-8d4f-e6a681161d24","Type":"ContainerDied","Data":"d51ca7d2b43895e48303755d1de7c9af1dc2116f2de0bea539ba8b34bc52d787"}
Oct 31 07:45:49.764031 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.763910    5039 scope.go:122] "RemoveContainer" containerID="a98efa9df7974f5ae6c16aebdf1da38cc75dffb93be17bb841ef7f667e28db28"
Oct 31 07:45:49.777396 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.777379    5039 scope.go:122] "RemoveContainer" containerID="32b830d82a1d78179bc2d8c17aca5c334d83d9d40e8dd28665e285c007c1bdaa"
Oct 31 07:45:49.786744 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.786723    5039 scope.go:122] "RemoveContainer" containerID="4573654de93764db060db7787208962636a4f32cb57b0e6d7830350d66b47a3e"
Oct 31 07:45:49.801215 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.801190    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"]
Oct 31 07:45:49.814268 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.814244    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-b67x9"]
Oct 31 07:45:49.844229 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.844201    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"]
Oct 31 07:45:49.850326 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.850300    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-2rrmk"]
Oct 31 07:45:49.882127 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.882047    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"]
Oct 31 07:45:49.885427 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.885398    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-f6whj"]
Oct 31 07:45:49.915746 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.915715    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"]
Oct 31 07:45:49.919709 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:49.919685    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-3dff3f-openshift-default-789d5dc677-kqflb"]
Oct 31 07:45:50.157225 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.156812    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:45:50.220860 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.220680    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:50.251981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.251622    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:45:50.257511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.257474    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321135    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-certs\") pod \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321252    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-kube-api-access-2zjnp\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-kube-api-access-2zjnp\") pod \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321332    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-podinfo\") pod \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321362    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-token\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-token\") pod \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321418    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-kube-api-access-dqc48\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-kube-api-access-dqc48\") pod \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321480    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-data\") pod \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321565    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-certs" pod "cbcd2d2a-6fb6-4466-983e-ad18f079a539" (UID: "cbcd2d2a-6fb6-4466-983e-ad18f079a539"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321670    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-certs\") pod \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321744    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-envoy\") pod \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321793    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-socket\") pod \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321837    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-data\") pod \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321872    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-credential-socket\") pod \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321899    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istiod-ca-cert\") pod \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321947    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istiod-ca-cert\") pod \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.321987    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-podinfo\") pod \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.322080    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-envoy\") pod \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\" (UID: \"cbcd2d2a-6fb6-4466-983e-ad18f079a539\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.322120    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-token\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-token\") pod \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.322165    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-socket\") pod \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.322195    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-credential-socket\") pod \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\" (UID: \"89d5021c-6cb7-4905-ae86-6a7cfca44a12\") "
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.322779    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.322891    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-credential-socket" pod "cbcd2d2a-6fb6-4466-983e-ad18f079a539" (UID: "cbcd2d2a-6fb6-4466-983e-ad18f079a539"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.322960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.322980    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-data" pod "cbcd2d2a-6fb6-4466-983e-ad18f079a539" (UID: "cbcd2d2a-6fb6-4466-983e-ad18f079a539"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.324748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.323140    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-socket" pod "cbcd2d2a-6fb6-4466-983e-ad18f079a539" (UID: "cbcd2d2a-6fb6-4466-983e-ad18f079a539"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.324748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.323183    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istiod-ca-cert" pod "89d5021c-6cb7-4905-ae86-6a7cfca44a12" (UID: "89d5021c-6cb7-4905-ae86-6a7cfca44a12"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:50.324748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.323780    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istiod-ca-cert" pod "cbcd2d2a-6fb6-4466-983e-ad18f079a539" (UID: "cbcd2d2a-6fb6-4466-983e-ad18f079a539"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:50.324748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.323977    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-credential-socket" pod "89d5021c-6cb7-4905-ae86-6a7cfca44a12" (UID: "89d5021c-6cb7-4905-ae86-6a7cfca44a12"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.324748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.324204    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-certs" pod "89d5021c-6cb7-4905-ae86-6a7cfca44a12" (UID: "89d5021c-6cb7-4905-ae86-6a7cfca44a12"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.324748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.324286    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-socket" pod "89d5021c-6cb7-4905-ae86-6a7cfca44a12" (UID: "89d5021c-6cb7-4905-ae86-6a7cfca44a12"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.324748 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.324361    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-data" pod "89d5021c-6cb7-4905-ae86-6a7cfca44a12" (UID: "89d5021c-6cb7-4905-ae86-6a7cfca44a12"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.325146 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.325095    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-kube-api-access-2zjnp" pod "89d5021c-6cb7-4905-ae86-6a7cfca44a12" (UID: "89d5021c-6cb7-4905-ae86-6a7cfca44a12"). InnerVolumeSpecName "kube-api-access-2zjnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:50.328011 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.327969    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-envoy" pod "cbcd2d2a-6fb6-4466-983e-ad18f079a539" (UID: "cbcd2d2a-6fb6-4466-983e-ad18f079a539"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.328136 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.328038    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-token" pod "cbcd2d2a-6fb6-4466-983e-ad18f079a539" (UID: "cbcd2d2a-6fb6-4466-983e-ad18f079a539"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:50.328339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.328313    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-podinfo" pod "89d5021c-6cb7-4905-ae86-6a7cfca44a12" (UID: "89d5021c-6cb7-4905-ae86-6a7cfca44a12"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:50.328455 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.328440    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-podinfo" pod "cbcd2d2a-6fb6-4466-983e-ad18f079a539" (UID: "cbcd2d2a-6fb6-4466-983e-ad18f079a539"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:50.329371 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.329332    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-kube-api-access-dqc48" pod "cbcd2d2a-6fb6-4466-983e-ad18f079a539" (UID: "cbcd2d2a-6fb6-4466-983e-ad18f079a539"). InnerVolumeSpecName "kube-api-access-dqc48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:50.329371 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.329363    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-envoy" pod "89d5021c-6cb7-4905-ae86-6a7cfca44a12" (UID: "89d5021c-6cb7-4905-ae86-6a7cfca44a12"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.330241 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.330220    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-token" pod "89d5021c-6cb7-4905-ae86-6a7cfca44a12" (UID: "89d5021c-6cb7-4905-ae86-6a7cfca44a12"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:50.424478 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.424378    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-certs\") pod \"2aee094c-6b06-4abf-b870-829c88c55137\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") "
Oct 31 07:45:50.424632 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.424481    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-istio-token\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-istio-token\") pod \"2aee094c-6b06-4abf-b870-829c88c55137\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") "
Oct 31 07:45:50.424632 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.424517    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-credential-socket\") pod \"2aee094c-6b06-4abf-b870-829c88c55137\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") "
Oct 31 07:45:50.424632 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.424596    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2aee094c-6b06-4abf-b870-829c88c55137-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aee094c-6b06-4abf-b870-829c88c55137-istio-podinfo\") pod \"2aee094c-6b06-4abf-b870-829c88c55137\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") "
Oct 31 07:45:50.424758 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.424727    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-certs" pod "2aee094c-6b06-4abf-b870-829c88c55137" (UID: "2aee094c-6b06-4abf-b870-829c88c55137"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.424970 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.424939    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-credential-socket" pod "2aee094c-6b06-4abf-b870-829c88c55137" (UID: "2aee094c-6b06-4abf-b870-829c88c55137"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.425110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425086    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-kube-api-access-jtfc9\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-kube-api-access-jtfc9\") pod \"2aee094c-6b06-4abf-b870-829c88c55137\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") "
Oct 31 07:45:50.425170 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425148    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-socket\") pod \"2aee094c-6b06-4abf-b870-829c88c55137\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") "
Oct 31 07:45:50.425231 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425200    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-envoy\") pod \"2aee094c-6b06-4abf-b870-829c88c55137\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") "
Oct 31 07:45:50.425286 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425258    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-data\") pod \"2aee094c-6b06-4abf-b870-829c88c55137\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") "
Oct 31 07:45:50.425347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425319    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2aee094c-6b06-4abf-b870-829c88c55137-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aee094c-6b06-4abf-b870-829c88c55137-istiod-ca-cert\") pod \"2aee094c-6b06-4abf-b870-829c88c55137\" (UID: \"2aee094c-6b06-4abf-b870-829c88c55137\") "
Oct 31 07:45:50.425463 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425435    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-socket" pod "2aee094c-6b06-4abf-b870-829c88c55137" (UID: "2aee094c-6b06-4abf-b870-829c88c55137"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.425730 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425628    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-data" pod "2aee094c-6b06-4abf-b870-829c88c55137" (UID: "2aee094c-6b06-4abf-b870-829c88c55137"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425898    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425940    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425951    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aee094c-6b06-4abf-b870-829c88c55137-istiod-ca-cert" pod "2aee094c-6b06-4abf-b870-829c88c55137" (UID: "2aee094c-6b06-4abf-b870-829c88c55137"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425957    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425980    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.425991    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426000    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426009    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zjnp\" (UniqueName: \"kubernetes.io/projected/89d5021c-6cb7-4905-ae86-6a7cfca44a12-kube-api-access-2zjnp\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426022    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426035    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426048    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqc48\" (UniqueName: \"kubernetes.io/projected/cbcd2d2a-6fb6-4466-983e-ad18f079a539-kube-api-access-dqc48\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426056    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426064    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426072    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426082    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426089    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426097    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426105    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426114    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbcd2d2a-6fb6-4466-983e-ad18f079a539-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426122    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426130    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbcd2d2a-6fb6-4466-983e-ad18f079a539-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.426154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.426138    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/89d5021c-6cb7-4905-ae86-6a7cfca44a12-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.427232 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.427208    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-istio-token" pod "2aee094c-6b06-4abf-b870-829c88c55137" (UID: "2aee094c-6b06-4abf-b870-829c88c55137"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:50.427429 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.427402    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2aee094c-6b06-4abf-b870-829c88c55137-istio-podinfo" pod "2aee094c-6b06-4abf-b870-829c88c55137" (UID: "2aee094c-6b06-4abf-b870-829c88c55137"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:45:50.428015 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.427994    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-kube-api-access-jtfc9" pod "2aee094c-6b06-4abf-b870-829c88c55137" (UID: "2aee094c-6b06-4abf-b870-829c88c55137"). InnerVolumeSpecName "kube-api-access-jtfc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:50.428596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.428578    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-envoy" pod "2aee094c-6b06-4abf-b870-829c88c55137" (UID: "2aee094c-6b06-4abf-b870-829c88c55137"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:45:50.527474 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.527432    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.527474 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.527469    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aee094c-6b06-4abf-b870-829c88c55137-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.527474 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.527479    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtfc9\" (UniqueName: \"kubernetes.io/projected/2aee094c-6b06-4abf-b870-829c88c55137-kube-api-access-jtfc9\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.527716 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.527488    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aee094c-6b06-4abf-b870-829c88c55137-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.527716 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.527498    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aee094c-6b06-4abf-b870-829c88c55137-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:50.767886 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.767846    5039 generic.go:356] "Generic (PLEG): container finished" podID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerID="e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808" exitCode=0
Oct 31 07:45:50.768354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.767949    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" event={"ID":"89d5021c-6cb7-4905-ae86-6a7cfca44a12","Type":"ContainerDied","Data":"e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808"}
Oct 31 07:45:50.768354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.768013    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh" event={"ID":"89d5021c-6cb7-4905-ae86-6a7cfca44a12","Type":"ContainerDied","Data":"0a7c1a43cf1b1338f7d41803b95948a1e80403b2b8220f9bf764e29170efb2d8"}
Oct 31 07:45:50.768354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.768044    5039 scope.go:122] "RemoveContainer" containerID="e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808"
Oct 31 07:45:50.768478 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.768378    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"
Oct 31 07:45:50.779517 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.777900    5039 generic.go:356] "Generic (PLEG): container finished" podID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerID="a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a" exitCode=0
Oct 31 07:45:50.779517 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.778042    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" event={"ID":"cbcd2d2a-6fb6-4466-983e-ad18f079a539","Type":"ContainerDied","Data":"a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a"}
Oct 31 07:45:50.779517 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.778089    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b" event={"ID":"cbcd2d2a-6fb6-4466-983e-ad18f079a539","Type":"ContainerDied","Data":"354c26642cda805c382ee7d840586c5ffd5ef8b341e8df6c22633916137c3707"}
Oct 31 07:45:50.779517 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.778192    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"
Oct 31 07:45:50.783074 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.783053    5039 scope.go:122] "RemoveContainer" containerID="e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808"
Oct 31 07:45:50.783640 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:50.783606    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808\": container with ID starting with e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808 not found: ID does not exist" containerID="e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808"
Oct 31 07:45:50.783743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.783654    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808"} err="failed to get container status \"e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808\": rpc error: code = NotFound desc = could not find container \"e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808\": container with ID starting with e846002281c50a66d362cd088198fedb57eeec5ee1f79697ca0c50658a0cf808 not found: ID does not exist"
Oct 31 07:45:50.783743 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.783677    5039 scope.go:122] "RemoveContainer" containerID="a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a"
Oct 31 07:45:50.783981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.783959    5039 generic.go:356] "Generic (PLEG): container finished" podID="2aee094c-6b06-4abf-b870-829c88c55137" containerID="36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f" exitCode=0
Oct 31 07:45:50.784087 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.784066    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" event={"ID":"2aee094c-6b06-4abf-b870-829c88c55137","Type":"ContainerDied","Data":"36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f"}
Oct 31 07:45:50.784162 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.784117    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4" event={"ID":"2aee094c-6b06-4abf-b870-829c88c55137","Type":"ContainerDied","Data":"e119011cf9b2c150991a49736940fc0507c4c542b3ba50c607e65e824d7f26b0"}
Oct 31 07:45:50.784214 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.784041    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"
Oct 31 07:45:50.799899 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.799877    5039 scope.go:122] "RemoveContainer" containerID="a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a"
Oct 31 07:45:50.800273 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:50.800242    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a\": container with ID starting with a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a not found: ID does not exist" containerID="a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a"
Oct 31 07:45:50.800360 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.800271    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a"} err="failed to get container status \"a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a\": rpc error: code = NotFound desc = could not find container \"a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a\": container with ID starting with a4106bfd26246ac8def4114f63ae0334fa64a780f772e8ab81a746857449743a not found: ID does not exist"
Oct 31 07:45:50.800360 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.800290    5039 scope.go:122] "RemoveContainer" containerID="36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f"
Oct 31 07:45:50.814102 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.814065    5039 scope.go:122] "RemoveContainer" containerID="36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f"
Oct 31 07:45:50.814549 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:50.814518    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f\": container with ID starting with 36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f not found: ID does not exist" containerID="36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f"
Oct 31 07:45:50.814722 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.814685    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f"} err="failed to get container status \"36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f\": rpc error: code = NotFound desc = could not find container \"36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f\": container with ID starting with 36580347fbe88b74139b80fd66f37771a5008b2bd7fcce02ad96330c05c9723f not found: ID does not exist"
Oct 31 07:45:50.838404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.838367    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"]
Oct 31 07:45:50.847505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.847473    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-95zqh"]
Oct 31 07:45:50.883909 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.883873    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"]
Oct 31 07:45:50.888947 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.888883    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-8h4k4"]
Oct 31 07:45:50.916516 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.916483    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"]
Oct 31 07:45:50.922424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:50.922390    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-3cc201-openshift-default-ddf9f7b95-6sl8b"]
Oct 31 07:45:51.098280 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.098189    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"]
Oct 31 07:45:51.099050 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099023    5039 cpu_manager.go:414] "containerMap: removing container" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main"
Oct 31 07:45:51.099050 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099051    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099077    5039 cpu_manager.go:414] "containerMap: removing container" podUID="db390f27-f119-44ef-8baf-33dc7a1e6a3d" containerName="revoke-keys"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099086    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db390f27-f119-44ef-8baf-33dc7a1e6a3d" containerName="revoke-keys"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099098    5039 cpu_manager.go:414] "containerMap: removing container" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099107    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099120    5039 cpu_manager.go:414] "containerMap: removing container" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099127    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099155    5039 cpu_manager.go:414] "containerMap: removing container" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099162    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099173    5039 cpu_manager.go:414] "containerMap: removing container" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main"
Oct 31 07:45:51.099183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099181    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099192    5039 cpu_manager.go:414] "containerMap: removing container" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099199    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099212    5039 cpu_manager.go:414] "containerMap: removing container" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099219    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099228    5039 cpu_manager.go:414] "containerMap: removing container" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099236    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099247    5039 cpu_manager.go:414] "containerMap: removing container" podUID="d0b234c3-44e8-4a22-96a3-c758c7cb8af4" containerName="payload-pre-processing"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099254    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d0b234c3-44e8-4a22-96a3-c758c7cb8af4" containerName="payload-pre-processing"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099276    5039 cpu_manager.go:414] "containerMap: removing container" podUID="b52efd47-605f-4417-bb71-9b59bcfb9cd9" containerName="revoke-keys"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099283    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b52efd47-605f-4417-bb71-9b59bcfb9cd9" containerName="revoke-keys"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099304    5039 cpu_manager.go:414] "containerMap: removing container" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099311    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099336    5039 cpu_manager.go:414] "containerMap: removing container" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099343    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099477    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="bd344b65-691d-401a-b1af-6c0dd8ae8b7f" containerName="main"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099490    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="db390f27-f119-44ef-8baf-33dc7a1e6a3d" containerName="revoke-keys"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099501    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy"
Oct 31 07:45:51.099511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099511    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" containerName="istio-proxy"
Oct 31 07:45:51.100321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099525    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" containerName="istio-proxy"
Oct 31 07:45:51.100321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099537    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="23046dd8-ddf6-4eac-a359-db2a4ef5fae6" containerName="main"
Oct 31 07:45:51.100321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099546    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" containerName="istio-proxy"
Oct 31 07:45:51.100321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099556    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="2aee094c-6b06-4abf-b870-829c88c55137" containerName="istio-proxy"
Oct 31 07:45:51.100321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099565    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" containerName="istio-proxy"
Oct 31 07:45:51.100321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099574    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="d0b234c3-44e8-4a22-96a3-c758c7cb8af4" containerName="payload-pre-processing"
Oct 31 07:45:51.100321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099585    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="b52efd47-605f-4417-bb71-9b59bcfb9cd9" containerName="revoke-keys"
Oct 31 07:45:51.100321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099597    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" containerName="istio-proxy"
Oct 31 07:45:51.100321 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.099609    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" containerName="istio-proxy"
Oct 31 07:45:51.105250 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.105216    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.124284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.120633    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:45:51.124284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.120768    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:45:51.124284 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.123624    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"]
Oct 31 07:45:51.237759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.237712    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkjvg\" (UniqueName: \"kubernetes.io/projected/2883f0c3-7a45-4613-93dd-fa8a18d89e91-kube-api-access-mkjvg\") pod \"maas-api-revoke-sub-31de0bd4-jnnnm\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.237975 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.237840    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-xks-ca\") pod \"maas-api-revoke-sub-31de0bd4-jnnnm\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.237975 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.237892    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-31de0bd4-jnnnm\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.339158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.339116    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkjvg\" (UniqueName: \"kubernetes.io/projected/2883f0c3-7a45-4613-93dd-fa8a18d89e91-kube-api-access-mkjvg\") pod \"maas-api-revoke-sub-31de0bd4-jnnnm\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.339158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.339165    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-xks-ca\") pod \"maas-api-revoke-sub-31de0bd4-jnnnm\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.339427 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.339192    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-31de0bd4-jnnnm\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.339949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.339906    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-31de0bd4-jnnnm\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.341597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.341567    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-xks-ca\") pod \"maas-api-revoke-sub-31de0bd4-jnnnm\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.357339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.357268    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkjvg\" (UniqueName: \"kubernetes.io/projected/2883f0c3-7a45-4613-93dd-fa8a18d89e91-kube-api-access-mkjvg\") pod \"maas-api-revoke-sub-31de0bd4-jnnnm\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.465689 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.465643    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:51.621951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.621851    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2aee094c-6b06-4abf-b870-829c88c55137" path="/var/lib/kubelet/pods/2aee094c-6b06-4abf-b870-829c88c55137/volumes"
Oct 31 07:45:51.622857 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.622831    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="40e932f2-848b-40ca-b59d-d77bc8e6090d" path="/var/lib/kubelet/pods/40e932f2-848b-40ca-b59d-d77bc8e6090d/volumes"
Oct 31 07:45:51.623637 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.623617    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="48d872d9-8044-41f9-b3ff-5a530abf893d" path="/var/lib/kubelet/pods/48d872d9-8044-41f9-b3ff-5a530abf893d/volumes"
Oct 31 07:45:51.624999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.624979    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8025aa84-ff53-40fe-8d4f-e6a681161d24" path="/var/lib/kubelet/pods/8025aa84-ff53-40fe-8d4f-e6a681161d24/volumes"
Oct 31 07:45:51.625706 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.625687    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="89d5021c-6cb7-4905-ae86-6a7cfca44a12" path="/var/lib/kubelet/pods/89d5021c-6cb7-4905-ae86-6a7cfca44a12/volumes"
Oct 31 07:45:51.626490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.626473    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bc664199-a36b-4404-9308-ef77ec4b2656" path="/var/lib/kubelet/pods/bc664199-a36b-4404-9308-ef77ec4b2656/volumes"
Oct 31 07:45:51.627705 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.627685    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cbcd2d2a-6fb6-4466-983e-ad18f079a539" path="/var/lib/kubelet/pods/cbcd2d2a-6fb6-4466-983e-ad18f079a539/volumes"
Oct 31 07:45:51.811290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.810888    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"]
Oct 31 07:45:51.921164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:51.921079    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:52.225579 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:52.225543    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:52.412794 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:52.412754    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:52.809123 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:52.809085    5039 generic.go:356] "Generic (PLEG): container finished" podID="2883f0c3-7a45-4613-93dd-fa8a18d89e91" containerID="108abb83e9a4638929b9bf6a60c824f42f85631cbd8b70c1fbf64fedb727a21f" exitCode=0
Oct 31 07:45:52.809285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:52.809167    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm" event={"ID":"2883f0c3-7a45-4613-93dd-fa8a18d89e91","Type":"ContainerDied","Data":"108abb83e9a4638929b9bf6a60c824f42f85631cbd8b70c1fbf64fedb727a21f"}
Oct 31 07:45:52.809285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:52.809219    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm" event={"ID":"2883f0c3-7a45-4613-93dd-fa8a18d89e91","Type":"ContainerStarted","Data":"c312756e2382aff469760443e2496e4a0dc9997358a7ec9ffc53937768cfc008"}
Oct 31 07:45:53.507380 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:53.507329    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:53.978960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:53.978931    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:54.075269 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.071331    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2883f0c3-7a45-4613-93dd-fa8a18d89e91-kube-api-access-mkjvg\" (UniqueName: \"kubernetes.io/projected/2883f0c3-7a45-4613-93dd-fa8a18d89e91-kube-api-access-mkjvg\") pod \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") "
Oct 31 07:45:54.075269 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.071412    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-openshift-ca\") pod \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") "
Oct 31 07:45:54.075269 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.071473    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-xks-ca\") pod \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\" (UID: \"2883f0c3-7a45-4613-93dd-fa8a18d89e91\") "
Oct 31 07:45:54.075269 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.074489    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-openshift-ca" pod "2883f0c3-7a45-4613-93dd-fa8a18d89e91" (UID: "2883f0c3-7a45-4613-93dd-fa8a18d89e91"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:45:54.083880 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.083842    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-xks-ca" pod "2883f0c3-7a45-4613-93dd-fa8a18d89e91" (UID: "2883f0c3-7a45-4613-93dd-fa8a18d89e91"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:45:54.085390 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.085357    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2883f0c3-7a45-4613-93dd-fa8a18d89e91-kube-api-access-mkjvg" pod "2883f0c3-7a45-4613-93dd-fa8a18d89e91" (UID: "2883f0c3-7a45-4613-93dd-fa8a18d89e91"). InnerVolumeSpecName "kube-api-access-mkjvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:45:54.173022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.172980    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkjvg\" (UniqueName: \"kubernetes.io/projected/2883f0c3-7a45-4613-93dd-fa8a18d89e91-kube-api-access-mkjvg\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:54.173022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.173012    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:54.173022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.173023    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2883f0c3-7a45-4613-93dd-fa8a18d89e91-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:45:54.586258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.586219    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:54.827158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.827126    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"
Oct 31 07:45:54.827158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.827148    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm" event={"ID":"2883f0c3-7a45-4613-93dd-fa8a18d89e91","Type":"ContainerDied","Data":"c312756e2382aff469760443e2496e4a0dc9997358a7ec9ffc53937768cfc008"}
Oct 31 07:45:54.827424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:54.827202    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c312756e2382aff469760443e2496e4a0dc9997358a7ec9ffc53937768cfc008"
Oct 31 07:45:55.201751 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:55.201719    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:56.450082 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:56.450042    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:57.002530 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:57.002495    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:57.187526 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:57.187472    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:57.367876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:57.367783    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:57.655705 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:57.655611    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:45:58.697129 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:45:58.697083    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:45:58.816663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:45:58.816628    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:00.256420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:00.256388    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:00.444844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:00.444803    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:01.794628 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:01.794585    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:02.809721 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:02.809683    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:03.034800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.034767    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"]
Oct 31 07:46:03.035310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.035296    5039 cpu_manager.go:414] "containerMap: removing container" podUID="2883f0c3-7a45-4613-93dd-fa8a18d89e91" containerName="revoke-keys"
Oct 31 07:46:03.035354 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.035312    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2883f0c3-7a45-4613-93dd-fa8a18d89e91" containerName="revoke-keys"
Oct 31 07:46:03.035416 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.035406    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="2883f0c3-7a45-4613-93dd-fa8a18d89e91" containerName="revoke-keys"
Oct 31 07:46:03.038737 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.038718    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.064254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.064162    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:46:03.064401 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.064295    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:46:03.068051 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.068023    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"]
Oct 31 07:46:03.073628 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.073597    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f47m\" (UniqueName: \"kubernetes.io/projected/49efbc44-acf7-47f5-80aa-ccca59e49a38-kube-api-access-6f47m\") pod \"maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.073754 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.073655    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.073865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.073839    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.174647 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.174611    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f47m\" (UniqueName: \"kubernetes.io/projected/49efbc44-acf7-47f5-80aa-ccca59e49a38-kube-api-access-6f47m\") pod \"maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.174804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.174665    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.174804 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.174733    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.175394 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.175358    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-openshift-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.177178 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.177154    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-xks-ca\") pod \"maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.193819 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.193786    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f47m\" (UniqueName: \"kubernetes.io/projected/49efbc44-acf7-47f5-80aa-ccca59e49a38-kube-api-access-6f47m\") pod \"maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.273570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.273531    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:03.353800 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.353715    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:03.473811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.473226    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:03.664632 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.664541    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"]
Oct 31 07:46:03.665520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.665495    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:03.668478 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:46:03.668449    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49efbc44_acf7_47f5_80aa_ccca59e49a38.slice/crio-d5e0277a574b3531afcd0a64666f072f7e50567d8a58f31b7601e5c40b122922 WatchSource:0}: Error finding container d5e0277a574b3531afcd0a64666f072f7e50567d8a58f31b7601e5c40b122922: Status 404 returned error can't find the container with id d5e0277a574b3531afcd0a64666f072f7e50567d8a58f31b7601e5c40b122922
Oct 31 07:46:03.897832 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:03.897795    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47" event={"ID":"49efbc44-acf7-47f5-80aa-ccca59e49a38","Type":"ContainerStarted","Data":"d5e0277a574b3531afcd0a64666f072f7e50567d8a58f31b7601e5c40b122922"}
Oct 31 07:46:04.495175 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:04.495133    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:04.771366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:04.771252    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:04.907253 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:04.907220    5039 generic.go:356] "Generic (PLEG): container finished" podID="49efbc44-acf7-47f5-80aa-ccca59e49a38" containerID="748fe34f351c1c5190adf83ef3aaa4a6c213970fcbcd0bbab02d40b0cfa06061" exitCode=0
Oct 31 07:46:04.907631 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:04.907309    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47" event={"ID":"49efbc44-acf7-47f5-80aa-ccca59e49a38","Type":"ContainerDied","Data":"748fe34f351c1c5190adf83ef3aaa4a6c213970fcbcd0bbab02d40b0cfa06061"}
Oct 31 07:46:05.315887 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:05.315854    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:05.523371 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:05.523330    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:06.072420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.072393    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:06.110007 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.109977    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-xks-ca\") pod \"49efbc44-acf7-47f5-80aa-ccca59e49a38\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") "
Oct 31 07:46:06.110153 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.110102    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/49efbc44-acf7-47f5-80aa-ccca59e49a38-kube-api-access-6f47m\" (UniqueName: \"kubernetes.io/projected/49efbc44-acf7-47f5-80aa-ccca59e49a38-kube-api-access-6f47m\") pod \"49efbc44-acf7-47f5-80aa-ccca59e49a38\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") "
Oct 31 07:46:06.110233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.110173    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-openshift-ca\") pod \"49efbc44-acf7-47f5-80aa-ccca59e49a38\" (UID: \"49efbc44-acf7-47f5-80aa-ccca59e49a38\") "
Oct 31 07:46:06.110597 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.110563    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-openshift-ca" pod "49efbc44-acf7-47f5-80aa-ccca59e49a38" (UID: "49efbc44-acf7-47f5-80aa-ccca59e49a38"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:06.112411 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.112380    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-xks-ca" pod "49efbc44-acf7-47f5-80aa-ccca59e49a38" (UID: "49efbc44-acf7-47f5-80aa-ccca59e49a38"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:46:06.112613 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.112572    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49efbc44-acf7-47f5-80aa-ccca59e49a38-kube-api-access-6f47m" pod "49efbc44-acf7-47f5-80aa-ccca59e49a38" (UID: "49efbc44-acf7-47f5-80aa-ccca59e49a38"). InnerVolumeSpecName "kube-api-access-6f47m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:06.211327 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.211295    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:06.211327 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.211326    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f47m\" (UniqueName: \"kubernetes.io/projected/49efbc44-acf7-47f5-80aa-ccca59e49a38-kube-api-access-6f47m\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:06.211529 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.211339    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/49efbc44-acf7-47f5-80aa-ccca59e49a38-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:06.832900 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.832865    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:06.923105 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.923076    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"
Oct 31 07:46:06.923105 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.923098    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47" event={"ID":"49efbc44-acf7-47f5-80aa-ccca59e49a38","Type":"ContainerDied","Data":"d5e0277a574b3531afcd0a64666f072f7e50567d8a58f31b7601e5c40b122922"}
Oct 31 07:46:06.923309 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:06.923146    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5e0277a574b3531afcd0a64666f072f7e50567d8a58f31b7601e5c40b122922"
Oct 31 07:46:07.114461 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:07.114370    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:07.810942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:07.809970    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"]
Oct 31 07:46:07.868138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:07.868094    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"]
Oct 31 07:46:07.911949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:07.908402    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:08.694268 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:08.694224    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:10.213020 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:10.212983    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:11.367103 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:11.367072    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:11.731630 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:11.731582    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:13.294496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:13.294462    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:13.658704 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:13.658590    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:13.850981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:13.850941    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:14.704668 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.704631    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"]
Oct 31 07:46:14.705197 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.705182    5039 cpu_manager.go:414] "containerMap: removing container" podUID="49efbc44-acf7-47f5-80aa-ccca59e49a38" containerName="revoke-keys"
Oct 31 07:46:14.705242 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.705197    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="49efbc44-acf7-47f5-80aa-ccca59e49a38" containerName="revoke-keys"
Oct 31 07:46:14.705290 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.705281    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="49efbc44-acf7-47f5-80aa-ccca59e49a38" containerName="revoke-keys"
Oct 31 07:46:14.710307 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.710285    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:14.726001 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.725972    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"]
Oct 31 07:46:14.734229 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.734199    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:46:14.734507 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.734486    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:46:14.800552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.800513    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"]
Oct 31 07:46:14.800777 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.800751    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy" containerID="cri-o://20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3" gracePeriod=30
Oct 31 07:46:14.806779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.806747    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"]
Oct 31 07:46:14.807219 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.807186    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy" containerID="cri-o://91020480c3c619c829af074fb50ffb0adaddaeea619ab64d1b4917d6ddb4ff90" gracePeriod=30
Oct 31 07:46:14.812157 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.812134    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"]
Oct 31 07:46:14.812511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.812477    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy" containerID="cri-o://9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd" gracePeriod=30
Oct 31 07:46:14.822884 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.822858    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:14.829498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.829462    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-091c1d6e-cb4bs\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:14.829498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.829506    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-091c1d6e-cb4bs\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:14.829674 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.829599    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lz94s\" (UniqueName: \"kubernetes.io/projected/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-kube-api-access-lz94s\") pod \"maas-api-revoke-sub-091c1d6e-cb4bs\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:14.931402 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.931350    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-091c1d6e-cb4bs\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:14.931402 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.931391    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-091c1d6e-cb4bs\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:14.932116 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.931426    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lz94s\" (UniqueName: \"kubernetes.io/projected/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-kube-api-access-lz94s\") pod \"maas-api-revoke-sub-091c1d6e-cb4bs\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:14.932373 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.932331    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-091c1d6e-cb4bs\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:14.934193 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.934163    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-091c1d6e-cb4bs\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:14.950262 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:14.950230    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lz94s\" (UniqueName: \"kubernetes.io/projected/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-kube-api-access-lz94s\") pod \"maas-api-revoke-sub-091c1d6e-cb4bs\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:15.024398 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:15.024309    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:15.331254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:15.331165    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"]
Oct 31 07:46:15.334897 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:46:15.334848    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8491677_90c0_4878_ae1e_d7f8e86f1cc1.slice/crio-7173bda74983d6d3fe4c99e62bcfee1d5a337c1d58ed8f32c06c5faf072b3f26 WatchSource:0}: Error finding container 7173bda74983d6d3fe4c99e62bcfee1d5a337c1d58ed8f32c06c5faf072b3f26: Status 404 returned error can't find the container with id 7173bda74983d6d3fe4c99e62bcfee1d5a337c1d58ed8f32c06c5faf072b3f26
Oct 31 07:46:15.721085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:15.721046    5039 patch_prober.go:29] interesting pod/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 07:46:15.721554 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:15.721109    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:46:16.248102 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:16.248063    5039 generic.go:356] "Generic (PLEG): container finished" podID="f8491677-90c0-4878-ae1e-d7f8e86f1cc1" containerID="df8836b9de86cee4b11910e4a12ba2bab23d32c180fb0495703c9e64b902243e" exitCode=0
Oct 31 07:46:16.248523 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:16.248144    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs" event={"ID":"f8491677-90c0-4878-ae1e-d7f8e86f1cc1","Type":"ContainerDied","Data":"df8836b9de86cee4b11910e4a12ba2bab23d32c180fb0495703c9e64b902243e"}
Oct 31 07:46:16.248523 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:16.248198    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs" event={"ID":"f8491677-90c0-4878-ae1e-d7f8e86f1cc1","Type":"ContainerStarted","Data":"7173bda74983d6d3fe4c99e62bcfee1d5a337c1d58ed8f32c06c5faf072b3f26"}
Oct 31 07:46:16.863654 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:16.863609    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:17.418057 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.418026    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:17.565894 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.565804    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-openshift-ca\") pod \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") "
Oct 31 07:46:17.565894 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.565851    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-xks-ca\") pod \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") "
Oct 31 07:46:17.565894 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.565874    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-kube-api-access-lz94s\" (UniqueName: \"kubernetes.io/projected/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-kube-api-access-lz94s\") pod \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\" (UID: \"f8491677-90c0-4878-ae1e-d7f8e86f1cc1\") "
Oct 31 07:46:17.566329 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.566298    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-openshift-ca" pod "f8491677-90c0-4878-ae1e-d7f8e86f1cc1" (UID: "f8491677-90c0-4878-ae1e-d7f8e86f1cc1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:17.568076 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.568048    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-xks-ca" pod "f8491677-90c0-4878-ae1e-d7f8e86f1cc1" (UID: "f8491677-90c0-4878-ae1e-d7f8e86f1cc1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:46:17.568174 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.568128    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-kube-api-access-lz94s" pod "f8491677-90c0-4878-ae1e-d7f8e86f1cc1" (UID: "f8491677-90c0-4878-ae1e-d7f8e86f1cc1"). InnerVolumeSpecName "kube-api-access-lz94s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:17.667343 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.667307    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:17.667343 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.667341    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:17.667343 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:17.667350    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lz94s\" (UniqueName: \"kubernetes.io/projected/f8491677-90c0-4878-ae1e-d7f8e86f1cc1-kube-api-access-lz94s\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:18.272964 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:18.272907    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs" event={"ID":"f8491677-90c0-4878-ae1e-d7f8e86f1cc1","Type":"ContainerDied","Data":"7173bda74983d6d3fe4c99e62bcfee1d5a337c1d58ed8f32c06c5faf072b3f26"}
Oct 31 07:46:18.273420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:18.272969    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"
Oct 31 07:46:18.273512 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:18.273399    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7173bda74983d6d3fe4c99e62bcfee1d5a337c1d58ed8f32c06c5faf072b3f26"
Oct 31 07:46:20.112352 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.112321    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:46:20.124746 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.124715    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:46:20.204936 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.204836    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-envoy\") pod \"32141a6a-3864-4ad1-92f5-ce680c399ebb\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") "
Oct 31 07:46:20.204936 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.204933    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-data\") pod \"1381d0c5-4a0d-4f52-9588-e5011ea39747\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") "
Oct 31 07:46:20.205182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.204970    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-podinfo\") pod \"1381d0c5-4a0d-4f52-9588-e5011ea39747\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") "
Oct 31 07:46:20.205182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205021    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-certs\") pod \"32141a6a-3864-4ad1-92f5-ce680c399ebb\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") "
Oct 31 07:46:20.205182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205048    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-socket\") pod \"1381d0c5-4a0d-4f52-9588-e5011ea39747\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") "
Oct 31 07:46:20.205182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205094    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-socket\") pod \"32141a6a-3864-4ad1-92f5-ce680c399ebb\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") "
Oct 31 07:46:20.205182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205143    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-credential-socket\") pod \"32141a6a-3864-4ad1-92f5-ce680c399ebb\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") "
Oct 31 07:46:20.205182 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205175    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1381d0c5-4a0d-4f52-9588-e5011ea39747-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1381d0c5-4a0d-4f52-9588-e5011ea39747-istiod-ca-cert\") pod \"1381d0c5-4a0d-4f52-9588-e5011ea39747\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") "
Oct 31 07:46:20.205496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205205    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-token\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-token\") pod \"32141a6a-3864-4ad1-92f5-ce680c399ebb\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") "
Oct 31 07:46:20.205496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205221    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-data" pod "1381d0c5-4a0d-4f52-9588-e5011ea39747" (UID: "1381d0c5-4a0d-4f52-9588-e5011ea39747"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.205496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205254    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-podinfo\") pod \"32141a6a-3864-4ad1-92f5-ce680c399ebb\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") "
Oct 31 07:46:20.205496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205311    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-certs\") pod \"1381d0c5-4a0d-4f52-9588-e5011ea39747\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") "
Oct 31 07:46:20.205496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205340    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/32141a6a-3864-4ad1-92f5-ce680c399ebb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32141a6a-3864-4ad1-92f5-ce680c399ebb-istiod-ca-cert\") pod \"32141a6a-3864-4ad1-92f5-ce680c399ebb\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") "
Oct 31 07:46:20.205496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205394    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-envoy\") pod \"1381d0c5-4a0d-4f52-9588-e5011ea39747\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") "
Oct 31 07:46:20.205496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205432    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-socket" pod "32141a6a-3864-4ad1-92f5-ce680c399ebb" (UID: "32141a6a-3864-4ad1-92f5-ce680c399ebb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.205496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205441    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-credential-socket\") pod \"1381d0c5-4a0d-4f52-9588-e5011ea39747\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") "
Oct 31 07:46:20.205496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205484    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-data\") pod \"32141a6a-3864-4ad1-92f5-ce680c399ebb\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") "
Oct 31 07:46:20.205979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205515    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-kube-api-access-t5rfr\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-kube-api-access-t5rfr\") pod \"1381d0c5-4a0d-4f52-9588-e5011ea39747\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") "
Oct 31 07:46:20.205979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205578    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-token\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-token\") pod \"1381d0c5-4a0d-4f52-9588-e5011ea39747\" (UID: \"1381d0c5-4a0d-4f52-9588-e5011ea39747\") "
Oct 31 07:46:20.205979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205614    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-kube-api-access-pdkkx\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-kube-api-access-pdkkx\") pod \"32141a6a-3864-4ad1-92f5-ce680c399ebb\" (UID: \"32141a6a-3864-4ad1-92f5-ce680c399ebb\") "
Oct 31 07:46:20.205979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205662    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-certs" pod "32141a6a-3864-4ad1-92f5-ce680c399ebb" (UID: "32141a6a-3864-4ad1-92f5-ce680c399ebb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.205979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205848    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-socket" pod "1381d0c5-4a0d-4f52-9588-e5011ea39747" (UID: "1381d0c5-4a0d-4f52-9588-e5011ea39747"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.205979 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.205801    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-credential-socket" pod "1381d0c5-4a0d-4f52-9588-e5011ea39747" (UID: "1381d0c5-4a0d-4f52-9588-e5011ea39747"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.206305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.206215    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32141a6a-3864-4ad1-92f5-ce680c399ebb-istiod-ca-cert" pod "32141a6a-3864-4ad1-92f5-ce680c399ebb" (UID: "32141a6a-3864-4ad1-92f5-ce680c399ebb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:20.206305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.206226    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.206305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.206246    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.206305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.206259    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.206305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.206272    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.206305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.206283    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.206623 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.206337    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-certs" pod "1381d0c5-4a0d-4f52-9588-e5011ea39747" (UID: "1381d0c5-4a0d-4f52-9588-e5011ea39747"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.206623 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.206550    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-data" pod "32141a6a-3864-4ad1-92f5-ce680c399ebb" (UID: "32141a6a-3864-4ad1-92f5-ce680c399ebb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.206735 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.206708    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-credential-socket" pod "32141a6a-3864-4ad1-92f5-ce680c399ebb" (UID: "32141a6a-3864-4ad1-92f5-ce680c399ebb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.209998 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.207013    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1381d0c5-4a0d-4f52-9588-e5011ea39747-istiod-ca-cert" pod "1381d0c5-4a0d-4f52-9588-e5011ea39747" (UID: "1381d0c5-4a0d-4f52-9588-e5011ea39747"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:20.209998 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.207645    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-envoy" pod "32141a6a-3864-4ad1-92f5-ce680c399ebb" (UID: "32141a6a-3864-4ad1-92f5-ce680c399ebb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.212679 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.212644    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-kube-api-access-pdkkx" pod "32141a6a-3864-4ad1-92f5-ce680c399ebb" (UID: "32141a6a-3864-4ad1-92f5-ce680c399ebb"). InnerVolumeSpecName "kube-api-access-pdkkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:20.213180 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.213156    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-podinfo" pod "32141a6a-3864-4ad1-92f5-ce680c399ebb" (UID: "32141a6a-3864-4ad1-92f5-ce680c399ebb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:46:20.213463 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.213314    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-kube-api-access-t5rfr" pod "1381d0c5-4a0d-4f52-9588-e5011ea39747" (UID: "1381d0c5-4a0d-4f52-9588-e5011ea39747"). InnerVolumeSpecName "kube-api-access-t5rfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:20.215276 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.215248    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-token" pod "32141a6a-3864-4ad1-92f5-ce680c399ebb" (UID: "32141a6a-3864-4ad1-92f5-ce680c399ebb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:20.215489 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.215385    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-token" pod "1381d0c5-4a0d-4f52-9588-e5011ea39747" (UID: "1381d0c5-4a0d-4f52-9588-e5011ea39747"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:20.216058 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.216035    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-envoy" pod "1381d0c5-4a0d-4f52-9588-e5011ea39747" (UID: "1381d0c5-4a0d-4f52-9588-e5011ea39747"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.225294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.219462    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-podinfo" pod "1381d0c5-4a0d-4f52-9588-e5011ea39747" (UID: "1381d0c5-4a0d-4f52-9588-e5011ea39747"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:46:20.290632 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.290595    5039 generic.go:356] "Generic (PLEG): container finished" podID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerID="91020480c3c619c829af074fb50ffb0adaddaeea619ab64d1b4917d6ddb4ff90" exitCode=0
Oct 31 07:46:20.290821 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.290660    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" event={"ID":"65df80c4-a26b-40c9-b38b-6a71b7935fb8","Type":"ContainerDied","Data":"91020480c3c619c829af074fb50ffb0adaddaeea619ab64d1b4917d6ddb4ff90"}
Oct 31 07:46:20.290821 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.290723    5039 scope.go:122] "RemoveContainer" containerID="4e0e0d5ecf0f80afbf14db5c5360ca06c54eefa1890ea37fb811c4343494c8db"
Oct 31 07:46:20.292464 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.292437    5039 generic.go:356] "Generic (PLEG): container finished" podID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerID="20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3" exitCode=0
Oct 31 07:46:20.292587 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.292570    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" event={"ID":"1381d0c5-4a0d-4f52-9588-e5011ea39747","Type":"ContainerDied","Data":"20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3"}
Oct 31 07:46:20.292633 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.292610    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg" event={"ID":"1381d0c5-4a0d-4f52-9588-e5011ea39747","Type":"ContainerDied","Data":"cc1ed4d213685fd4a37e5b89adfa62e1f2f3de91d85d05d23bbccfd27ba4d214"}
Oct 31 07:46:20.292691 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.292680    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"
Oct 31 07:46:20.304186 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.294746    5039 generic.go:356] "Generic (PLEG): container finished" podID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerID="9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd" exitCode=0
Oct 31 07:46:20.304186 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.294787    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" event={"ID":"32141a6a-3864-4ad1-92f5-ce680c399ebb","Type":"ContainerDied","Data":"9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd"}
Oct 31 07:46:20.304186 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.294826    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l" event={"ID":"32141a6a-3864-4ad1-92f5-ce680c399ebb","Type":"ContainerDied","Data":"d43df28958c4a6911e4f09f8ecdb5c8ce74de88d12b68b1d8dc242352692590f"}
Oct 31 07:46:20.304186 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.294900    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"
Oct 31 07:46:20.306294 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.306205    5039 scope.go:122] "RemoveContainer" containerID="20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3"
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.306973    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307000    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1381d0c5-4a0d-4f52-9588-e5011ea39747-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307015    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307028    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307040    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307052    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/32141a6a-3864-4ad1-92f5-ce680c399ebb-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307064    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307076    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307088    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5rfr\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-kube-api-access-t5rfr\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307098    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307108    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdkkx\" (UniqueName: \"kubernetes.io/projected/32141a6a-3864-4ad1-92f5-ce680c399ebb-kube-api-access-pdkkx\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307116    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/32141a6a-3864-4ad1-92f5-ce680c399ebb-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.307350 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.307124    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1381d0c5-4a0d-4f52-9588-e5011ea39747-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.319196 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.319078    5039 scope.go:122] "RemoveContainer" containerID="20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3"
Oct 31 07:46:20.319490 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:20.319462    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3\": container with ID starting with 20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3 not found: ID does not exist" containerID="20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3"
Oct 31 07:46:20.319589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.319502    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3"} err="failed to get container status \"20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3\": rpc error: code = NotFound desc = could not find container \"20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3\": container with ID starting with 20edcfd0375d6ad89d38aa03137d5a7f6355db3b785226b93ff1b1fa94e044d3 not found: ID does not exist"
Oct 31 07:46:20.319589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.319527    5039 scope.go:122] "RemoveContainer" containerID="9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd"
Oct 31 07:46:20.329877 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.329815    5039 scope.go:122] "RemoveContainer" containerID="9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd"
Oct 31 07:46:20.330239 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:20.330202    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd\": container with ID starting with 9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd not found: ID does not exist" containerID="9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd"
Oct 31 07:46:20.330422 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.330251    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd"} err="failed to get container status \"9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd\": rpc error: code = NotFound desc = could not find container \"9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd\": container with ID starting with 9845f1e840cbb2413963a230e5de3d7cd9b2c1f8197f7d54614e3af98e95b8fd not found: ID does not exist"
Oct 31 07:46:20.344101 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.344028    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"]
Oct 31 07:46:20.347451 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.347421    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-h8scg"]
Oct 31 07:46:20.389788 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.389745    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"]
Oct 31 07:46:20.396690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.396641    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-csg6l"]
Oct 31 07:46:20.476039 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.476012    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:46:20.611017 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.610897    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-token\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-token\") pod \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") "
Oct 31 07:46:20.611017 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.610971    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-envoy\") pod \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") "
Oct 31 07:46:20.611017 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611017    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-podinfo\") pod \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") "
Oct 31 07:46:20.611295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611043    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-credential-socket\") pod \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") "
Oct 31 07:46:20.611295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611076    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-kube-api-access-slnnm\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-kube-api-access-slnnm\") pod \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") "
Oct 31 07:46:20.611295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611137    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-certs\") pod \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") "
Oct 31 07:46:20.611295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611194    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istiod-ca-cert\") pod \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") "
Oct 31 07:46:20.611295 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611263    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-socket\") pod \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") "
Oct 31 07:46:20.611553 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611301    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-data\") pod \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\" (UID: \"65df80c4-a26b-40c9-b38b-6a71b7935fb8\") "
Oct 31 07:46:20.611615 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611561    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-certs" pod "65df80c4-a26b-40c9-b38b-6a71b7935fb8" (UID: "65df80c4-a26b-40c9-b38b-6a71b7935fb8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.611701 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611659    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istiod-ca-cert" pod "65df80c4-a26b-40c9-b38b-6a71b7935fb8" (UID: "65df80c4-a26b-40c9-b38b-6a71b7935fb8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:20.611789 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611758    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-credential-socket" pod "65df80c4-a26b-40c9-b38b-6a71b7935fb8" (UID: "65df80c4-a26b-40c9-b38b-6a71b7935fb8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.611789 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611779    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-socket" pod "65df80c4-a26b-40c9-b38b-6a71b7935fb8" (UID: "65df80c4-a26b-40c9-b38b-6a71b7935fb8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.611949 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.611905    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-data" pod "65df80c4-a26b-40c9-b38b-6a71b7935fb8" (UID: "65df80c4-a26b-40c9-b38b-6a71b7935fb8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.612101 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.612071    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.612101 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.612093    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.612198 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.612109    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.612198 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.612123    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.612198 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.612135    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.613471 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.613447    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-podinfo" pod "65df80c4-a26b-40c9-b38b-6a71b7935fb8" (UID: "65df80c4-a26b-40c9-b38b-6a71b7935fb8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:46:20.613765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.613746    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-token" pod "65df80c4-a26b-40c9-b38b-6a71b7935fb8" (UID: "65df80c4-a26b-40c9-b38b-6a71b7935fb8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:20.614007 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.613985    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-envoy" pod "65df80c4-a26b-40c9-b38b-6a71b7935fb8" (UID: "65df80c4-a26b-40c9-b38b-6a71b7935fb8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:20.614083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.613991    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-kube-api-access-slnnm" pod "65df80c4-a26b-40c9-b38b-6a71b7935fb8" (UID: "65df80c4-a26b-40c9-b38b-6a71b7935fb8"). InnerVolumeSpecName "kube-api-access-slnnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:20.713753 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.713704    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.713753 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.713751    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.714002 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.713766    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65df80c4-a26b-40c9-b38b-6a71b7935fb8-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:20.714002 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:20.713780    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slnnm\" (UniqueName: \"kubernetes.io/projected/65df80c4-a26b-40c9-b38b-6a71b7935fb8-kube-api-access-slnnm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:21.305807 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:21.305759    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4" event={"ID":"65df80c4-a26b-40c9-b38b-6a71b7935fb8","Type":"ContainerDied","Data":"ed2dd19406b67cc646fc7d3ad94fcaead11954fc1ddfa4dacae00a6042c7da09"}
Oct 31 07:46:21.306241 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:21.305859    5039 scope.go:122] "RemoveContainer" containerID="91020480c3c619c829af074fb50ffb0adaddaeea619ab64d1b4917d6ddb4ff90"
Oct 31 07:46:21.306241 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:21.305784    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"
Oct 31 07:46:21.366091 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:21.366056    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"]
Oct 31 07:46:21.377090 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:21.377063    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-4794f5-openshift-default-74dd558db5-tcrw4"]
Oct 31 07:46:21.616847 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:21.616764    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" path="/var/lib/kubelet/pods/1381d0c5-4a0d-4f52-9588-e5011ea39747/volumes"
Oct 31 07:46:21.617678 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:21.617663    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" path="/var/lib/kubelet/pods/32141a6a-3864-4ad1-92f5-ce680c399ebb/volumes"
Oct 31 07:46:21.618113 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:21.618099    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" path="/var/lib/kubelet/pods/65df80c4-a26b-40c9-b38b-6a71b7935fb8/volumes"
Oct 31 07:46:23.445962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.445899    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main" containerID="cri-o://d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1" gracePeriod=45
Oct 31 07:46:23.515703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.515665    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main" containerID="cri-o://c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a" gracePeriod=45
Oct 31 07:46:23.775205 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.775178    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:46:23.807158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.807135    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:46:23.950305 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950265    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tls-certs\" (UniqueName: \"kubernetes.io/secret/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tls-certs\") pod \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") "
Oct 31 07:46:23.950502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950317    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-home\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-home\") pod \"31be7050-993f-4d04-b410-ed54bebe5704\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") "
Oct 31 07:46:23.950502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950338    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-home\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-home\") pod \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") "
Oct 31 07:46:23.950502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950360    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-dshm\") pod \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") "
Oct 31 07:46:23.950502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950408    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-kube-api-access-jtmzt\" (UniqueName: \"kubernetes.io/projected/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-kube-api-access-jtmzt\") pod \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") "
Oct 31 07:46:23.950502 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950460    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-model-cache\") pod \"31be7050-993f-4d04-b410-ed54bebe5704\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") "
Oct 31 07:46:23.950779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950543    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/31be7050-993f-4d04-b410-ed54bebe5704-tls-certs\" (UniqueName: \"kubernetes.io/secret/31be7050-993f-4d04-b410-ed54bebe5704-tls-certs\") pod \"31be7050-993f-4d04-b410-ed54bebe5704\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") "
Oct 31 07:46:23.950779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950573    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/31be7050-993f-4d04-b410-ed54bebe5704-kube-api-access-hcd9z\" (UniqueName: \"kubernetes.io/projected/31be7050-993f-4d04-b410-ed54bebe5704-kube-api-access-hcd9z\") pod \"31be7050-993f-4d04-b410-ed54bebe5704\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") "
Oct 31 07:46:23.950779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950633    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tmp-dir\") pod \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") "
Oct 31 07:46:23.950779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950652    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-home" pod "31be7050-993f-4d04-b410-ed54bebe5704" (UID: "31be7050-993f-4d04-b410-ed54bebe5704"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:23.950779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950671    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-dshm\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-dshm\") pod \"31be7050-993f-4d04-b410-ed54bebe5704\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") "
Oct 31 07:46:23.950779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950693    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-home" pod "9be50c74-6e27-4c8c-a3ed-f1cdae35c303" (UID: "9be50c74-6e27-4c8c-a3ed-f1cdae35c303"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:23.950779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950730    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-model-cache" pod "31be7050-993f-4d04-b410-ed54bebe5704" (UID: "31be7050-993f-4d04-b410-ed54bebe5704"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:23.950779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950736    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-model-cache\") pod \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\" (UID: \"9be50c74-6e27-4c8c-a3ed-f1cdae35c303\") "
Oct 31 07:46:23.951248 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950815    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-tmp-dir\") pod \"31be7050-993f-4d04-b410-ed54bebe5704\" (UID: \"31be7050-993f-4d04-b410-ed54bebe5704\") "
Oct 31 07:46:23.951248 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.950969    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-model-cache" pod "9be50c74-6e27-4c8c-a3ed-f1cdae35c303" (UID: "9be50c74-6e27-4c8c-a3ed-f1cdae35c303"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:23.951248 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.951134    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tmp-dir" pod "9be50c74-6e27-4c8c-a3ed-f1cdae35c303" (UID: "9be50c74-6e27-4c8c-a3ed-f1cdae35c303"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:23.951406 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.951325    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-tmp-dir" pod "31be7050-993f-4d04-b410-ed54bebe5704" (UID: "31be7050-993f-4d04-b410-ed54bebe5704"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:23.951406 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.951383    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:23.951520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.951408    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:23.951520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.951424    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:23.951520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.951436    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:23.951520 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.951449    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:23.952947 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.952891    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31be7050-993f-4d04-b410-ed54bebe5704-kube-api-access-hcd9z" pod "31be7050-993f-4d04-b410-ed54bebe5704" (UID: "31be7050-993f-4d04-b410-ed54bebe5704"). InnerVolumeSpecName "kube-api-access-hcd9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:23.952947 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.952928    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-dshm" pod "9be50c74-6e27-4c8c-a3ed-f1cdae35c303" (UID: "9be50c74-6e27-4c8c-a3ed-f1cdae35c303"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:23.953119 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.953084    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tls-certs" pod "9be50c74-6e27-4c8c-a3ed-f1cdae35c303" (UID: "9be50c74-6e27-4c8c-a3ed-f1cdae35c303"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:46:23.953200 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.953180    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-kube-api-access-jtmzt" pod "9be50c74-6e27-4c8c-a3ed-f1cdae35c303" (UID: "9be50c74-6e27-4c8c-a3ed-f1cdae35c303"). InnerVolumeSpecName "kube-api-access-jtmzt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:23.953271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.953257    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31be7050-993f-4d04-b410-ed54bebe5704-tls-certs" pod "31be7050-993f-4d04-b410-ed54bebe5704" (UID: "31be7050-993f-4d04-b410-ed54bebe5704"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:46:23.953361 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:23.953349    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-dshm" pod "31be7050-993f-4d04-b410-ed54bebe5704" (UID: "31be7050-993f-4d04-b410-ed54bebe5704"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:24.053062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.052962    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtmzt\" (UniqueName: \"kubernetes.io/projected/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-kube-api-access-jtmzt\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:24.053062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.053002    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31be7050-993f-4d04-b410-ed54bebe5704-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:24.053062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.053016    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcd9z\" (UniqueName: \"kubernetes.io/projected/31be7050-993f-4d04-b410-ed54bebe5704-kube-api-access-hcd9z\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:24.053062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.053027    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:24.053062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.053038    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31be7050-993f-4d04-b410-ed54bebe5704-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:24.053062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.053049    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:24.053062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.053060    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9be50c74-6e27-4c8c-a3ed-f1cdae35c303-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:24.333772 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.333671    5039 generic.go:356] "Generic (PLEG): container finished" podID="31be7050-993f-4d04-b410-ed54bebe5704" containerID="d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1" exitCode=0
Oct 31 07:46:24.333772 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.333740    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"
Oct 31 07:46:24.333772 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.333757    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" event={"ID":"31be7050-993f-4d04-b410-ed54bebe5704","Type":"ContainerDied","Data":"d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1"}
Oct 31 07:46:24.334089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.333810    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g" event={"ID":"31be7050-993f-4d04-b410-ed54bebe5704","Type":"ContainerDied","Data":"d99c3b0de496ec3e4c02576e2c6f46f3195a0bbbed3b81c16e8fb6dda945d76f"}
Oct 31 07:46:24.334089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.333832    5039 scope.go:122] "RemoveContainer" containerID="d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1"
Oct 31 07:46:24.335400 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.335375    5039 generic.go:356] "Generic (PLEG): container finished" podID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerID="c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a" exitCode=0
Oct 31 07:46:24.335501 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.335446    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"
Oct 31 07:46:24.335501 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.335453    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" event={"ID":"9be50c74-6e27-4c8c-a3ed-f1cdae35c303","Type":"ContainerDied","Data":"c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a"}
Oct 31 07:46:24.335501 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.335493    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8" event={"ID":"9be50c74-6e27-4c8c-a3ed-f1cdae35c303","Type":"ContainerDied","Data":"0fa6ce9be8962731d4f5e6a02018be04cd40cac92eea04b609d4438138ca10a2"}
Oct 31 07:46:24.344939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.344898    5039 scope.go:122] "RemoveContainer" containerID="d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1"
Oct 31 07:46:24.345299 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:24.345214    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1\": container with ID starting with d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1 not found: ID does not exist" containerID="d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1"
Oct 31 07:46:24.345299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.345249    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1"} err="failed to get container status \"d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1\": rpc error: code = NotFound desc = could not find container \"d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1\": container with ID starting with d92c227193474f35af3ebdb498e542eea6cbde45f753390e86aff485124b57e1 not found: ID does not exist"
Oct 31 07:46:24.345299 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.345266    5039 scope.go:122] "RemoveContainer" containerID="c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a"
Oct 31 07:46:24.355402 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.355380    5039 scope.go:122] "RemoveContainer" containerID="c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a"
Oct 31 07:46:24.355658 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:24.355636    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a\": container with ID starting with c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a not found: ID does not exist" containerID="c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a"
Oct 31 07:46:24.355726 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.355664    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a"} err="failed to get container status \"c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a\": rpc error: code = NotFound desc = could not find container \"c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a\": container with ID starting with c0876d85c06e1ba64958e89a94980a89c45eb0a0804f80fbd42f8ba25cc82e0a not found: ID does not exist"
Oct 31 07:46:24.382347 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.382322    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"]
Oct 31 07:46:24.393233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.393207    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/premium-w2-b4e8fd-kserve-b6c64699-9zb7g"]
Oct 31 07:46:24.417084 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.417054    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"]
Oct 31 07:46:24.420243 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:24.420220    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-b4e8fd/distinct-2-w2-b4e8fd-kserve-5457f59cc7-qvzw8"]
Oct 31 07:46:25.614823 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:25.614788    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="31be7050-993f-4d04-b410-ed54bebe5704" path="/var/lib/kubelet/pods/31be7050-993f-4d04-b410-ed54bebe5704/volumes"
Oct 31 07:46:25.615282 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:25.615266    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" path="/var/lib/kubelet/pods/9be50c74-6e27-4c8c-a3ed-f1cdae35c303/volumes"
Oct 31 07:46:28.850942 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:28.850204    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:46:29.854857 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:29.854817    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:30.294723 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:30.294687    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:30.412704 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:30.412669    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"]
Oct 31 07:46:30.423602 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:30.423557    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w2-b4e8fd-wqn47"]
Oct 31 07:46:30.483221 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:30.483180    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:30.896630 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:30.896596    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:31.615443 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:31.615410    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="49efbc44-acf7-47f5-80aa-ccca59e49a38" path="/var/lib/kubelet/pods/49efbc44-acf7-47f5-80aa-ccca59e49a38/volumes"
Oct 31 07:46:36.652223 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.652193    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:36.845049 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.845018    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:36.973155 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.973116    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"]
Oct 31 07:46:36.973417 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.973385    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy" containerID="cri-o://4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565" gracePeriod=30
Oct 31 07:46:36.985844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.985811    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"]
Oct 31 07:46:36.986260 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.986212    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" containerID="cri-o://897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d" gracePeriod=30
Oct 31 07:46:36.990426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.990397    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"]
Oct 31 07:46:36.990653 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.990629    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy" containerID="cri-o://447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82" gracePeriod=30
Oct 31 07:46:36.994582 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.994557    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"]
Oct 31 07:46:36.994982 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:36.994955    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy" containerID="cri-o://00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685" gracePeriod=30
Oct 31 07:46:37.041535 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:37.041503    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:40.454121 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:40.454087    5039 generic.go:356] "Generic (PLEG): container finished" podID="bfe41bf6-ece6-425f-a0d4-04da4159aee9" containerID="93c8bf4f689755feb30b3b4526bf0e4b15ac6461b8ea42c9a35612b56b6ef141" exitCode=0
Oct 31 07:46:40.454503 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:40.454161    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-664rw-prslb" event={"ID":"bfe41bf6-ece6-425f-a0d4-04da4159aee9","Type":"ContainerDied","Data":"93c8bf4f689755feb30b3b4526bf0e4b15ac6461b8ea42c9a35612b56b6ef141"}
Oct 31 07:46:41.583247 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.583202    5039 patch_prober.go:29] interesting pod/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 07:46:41.583642 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.583285    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 07:46:41.606323 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.606296    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:46:41.682900 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.682862    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-service-ca-bundle\") pod \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") "
Oct 31 07:46:41.683112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.683021    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-trusted-ca-bundle\") pod \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") "
Oct 31 07:46:41.683112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.683043    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bfe41bf6-ece6-425f-a0d4-04da4159aee9-kube-api-access-qg48h\" (UniqueName: \"kubernetes.io/projected/bfe41bf6-ece6-425f-a0d4-04da4159aee9-kube-api-access-qg48h\") pod \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") "
Oct 31 07:46:41.683112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.683065    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bfe41bf6-ece6-425f-a0d4-04da4159aee9-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/bfe41bf6-ece6-425f-a0d4-04da4159aee9-archives-path\") pod \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\" (UID: \"bfe41bf6-ece6-425f-a0d4-04da4159aee9\") "
Oct 31 07:46:41.683406 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.683263    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-service-ca-bundle" pod "bfe41bf6-ece6-425f-a0d4-04da4159aee9" (UID: "bfe41bf6-ece6-425f-a0d4-04da4159aee9"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:41.683503 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.683482    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfe41bf6-ece6-425f-a0d4-04da4159aee9-archives-path" pod "bfe41bf6-ece6-425f-a0d4-04da4159aee9" (UID: "bfe41bf6-ece6-425f-a0d4-04da4159aee9"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:41.683566 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.683502    5039 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-service-ca-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:41.683728 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.683697    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-trusted-ca-bundle" pod "bfe41bf6-ece6-425f-a0d4-04da4159aee9" (UID: "bfe41bf6-ece6-425f-a0d4-04da4159aee9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:41.685315 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.685293    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe41bf6-ece6-425f-a0d4-04da4159aee9-kube-api-access-qg48h" pod "bfe41bf6-ece6-425f-a0d4-04da4159aee9" (UID: "bfe41bf6-ece6-425f-a0d4-04da4159aee9"). InnerVolumeSpecName "kube-api-access-qg48h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:41.784487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.784395    5039 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfe41bf6-ece6-425f-a0d4-04da4159aee9-trusted-ca-bundle\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:41.784487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.784430    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qg48h\" (UniqueName: \"kubernetes.io/projected/bfe41bf6-ece6-425f-a0d4-04da4159aee9-kube-api-access-qg48h\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:41.784487 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:41.784442    5039 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/bfe41bf6-ece6-425f-a0d4-04da4159aee9-archives-path\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.304754 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.304387    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:46:42.393940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.392743    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-credential-socket\") pod \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") "
Oct 31 07:46:42.393940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.392814    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-certs\") pod \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") "
Oct 31 07:46:42.393940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.392855    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-data\") pod \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") "
Oct 31 07:46:42.393940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.392908    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istiod-ca-cert\") pod \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") "
Oct 31 07:46:42.393940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.393015    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-token\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-token\") pod \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") "
Oct 31 07:46:42.393940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.393045    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-socket\") pod \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") "
Oct 31 07:46:42.393940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.393093    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-podinfo\") pod \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") "
Oct 31 07:46:42.393940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.393175    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-kube-api-access-dtbst\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-kube-api-access-dtbst\") pod \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") "
Oct 31 07:46:42.393940 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.393229    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-envoy\") pod \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\" (UID: \"db9040a4-bc18-4188-908c-1f3a4b2f97cd\") "
Oct 31 07:46:42.394856 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.394476    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-data" pod "db9040a4-bc18-4188-908c-1f3a4b2f97cd" (UID: "db9040a4-bc18-4188-908c-1f3a4b2f97cd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.394856 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.394557    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-credential-socket" pod "db9040a4-bc18-4188-908c-1f3a4b2f97cd" (UID: "db9040a4-bc18-4188-908c-1f3a4b2f97cd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.395137 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.395088    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-socket" pod "db9040a4-bc18-4188-908c-1f3a4b2f97cd" (UID: "db9040a4-bc18-4188-908c-1f3a4b2f97cd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.395751 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.395713    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-certs" pod "db9040a4-bc18-4188-908c-1f3a4b2f97cd" (UID: "db9040a4-bc18-4188-908c-1f3a4b2f97cd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.395960 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.395937    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istiod-ca-cert" pod "db9040a4-bc18-4188-908c-1f3a4b2f97cd" (UID: "db9040a4-bc18-4188-908c-1f3a4b2f97cd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:42.397637 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.397600    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-podinfo" pod "db9040a4-bc18-4188-908c-1f3a4b2f97cd" (UID: "db9040a4-bc18-4188-908c-1f3a4b2f97cd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:46:42.399228 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.399190    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-token" pod "db9040a4-bc18-4188-908c-1f3a4b2f97cd" (UID: "db9040a4-bc18-4188-908c-1f3a4b2f97cd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:42.403439 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.403406    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-kube-api-access-dtbst" pod "db9040a4-bc18-4188-908c-1f3a4b2f97cd" (UID: "db9040a4-bc18-4188-908c-1f3a4b2f97cd"). InnerVolumeSpecName "kube-api-access-dtbst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:42.406713 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.406687    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-envoy" pod "db9040a4-bc18-4188-908c-1f3a4b2f97cd" (UID: "db9040a4-bc18-4188-908c-1f3a4b2f97cd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.410766 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.410742    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:46:42.419220 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.419087    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:46:42.425902 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.425872    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:46:42.494903 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.494866    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-certs\") pod \"3fd74f30-bf87-4e02-b77c-b23535f4b943\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") "
Oct 31 07:46:42.495166 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.495142    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-podinfo\") pod \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") "
Oct 31 07:46:42.495414 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.495391    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-token\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-token\") pod \"3fd74f30-bf87-4e02-b77c-b23535f4b943\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") "
Oct 31 07:46:42.495552 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.495530    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-certs" pod "3fd74f30-bf87-4e02-b77c-b23535f4b943" (UID: "3fd74f30-bf87-4e02-b77c-b23535f4b943"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.495951 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.495804    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-data" pod "76d272c4-24c8-4ca8-8945-b72ccae3bdc8" (UID: "76d272c4-24c8-4ca8-8945-b72ccae3bdc8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.496069 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.495549    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-data\") pod \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") "
Oct 31 07:46:42.496687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.496473    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-664rw-prslb" event={"ID":"bfe41bf6-ece6-425f-a0d4-04da4159aee9","Type":"ContainerDied","Data":"fe2734aecc13fcb8a3047ac253607007efce831f703dbe02a36e6698aea94a07"}
Oct 31 07:46:42.496687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.496533    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fe2734aecc13fcb8a3047ac253607007efce831f703dbe02a36e6698aea94a07"
Oct 31 07:46:42.496687 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.496551    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-664rw-prslb"
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.499775    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-certs\") pod \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.499828    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-kube-api-access-rn7bs\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-kube-api-access-rn7bs\") pod \"3fd74f30-bf87-4e02-b77c-b23535f4b943\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.499876    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-socket\") pod \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.499943    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istiod-ca-cert\") pod \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.499983    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-envoy\") pod \"3fd74f30-bf87-4e02-b77c-b23535f4b943\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500043    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3fd74f30-bf87-4e02-b77c-b23535f4b943-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fd74f30-bf87-4e02-b77c-b23535f4b943-istiod-ca-cert\") pod \"3fd74f30-bf87-4e02-b77c-b23535f4b943\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500076    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-socket\") pod \"3fd74f30-bf87-4e02-b77c-b23535f4b943\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500114    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-credential-socket\") pod \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500153    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-podinfo\") pod \"3fd74f30-bf87-4e02-b77c-b23535f4b943\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500186    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-data\") pod \"3fd74f30-bf87-4e02-b77c-b23535f4b943\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500219    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-socket\") pod \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500268    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-kube-api-access-z4gbr\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-kube-api-access-z4gbr\") pod \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500315    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-certs\") pod \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500350    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-data\") pod \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500385    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-envoy\") pod \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500421    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-envoy\") pod \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500462    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-kube-api-access-62dwv\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-kube-api-access-62dwv\") pod \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") "
Oct 31 07:46:42.500490 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500501    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-credential-socket\") pod \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") "
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500536    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-podinfo\") pod \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") "
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500575    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-credential-socket\") pod \"3fd74f30-bf87-4e02-b77c-b23535f4b943\" (UID: \"3fd74f30-bf87-4e02-b77c-b23535f4b943\") "
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500611    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-token\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-token\") pod \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") "
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500662    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-token\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-token\") pod \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\" (UID: \"76d272c4-24c8-4ca8-8945-b72ccae3bdc8\") "
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.500704    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istiod-ca-cert\") pod \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\" (UID: \"92f2e69a-a921-4bcb-91bf-65144b3d2a7e\") "
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501185    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501206    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501220    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501233    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501246    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501260    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtbst\" (UniqueName: \"kubernetes.io/projected/db9040a4-bc18-4188-908c-1f3a4b2f97cd-kube-api-access-dtbst\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501274    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501287    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501303    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501317    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.501498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501329    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db9040a4-bc18-4188-908c-1f3a4b2f97cd-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.502310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501666    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istiod-ca-cert" pod "92f2e69a-a921-4bcb-91bf-65144b3d2a7e" (UID: "92f2e69a-a921-4bcb-91bf-65144b3d2a7e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:42.502310 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.501944    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-certs" pod "76d272c4-24c8-4ca8-8945-b72ccae3bdc8" (UID: "76d272c4-24c8-4ca8-8945-b72ccae3bdc8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.504254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.502845    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-credential-socket" pod "3fd74f30-bf87-4e02-b77c-b23535f4b943" (UID: "3fd74f30-bf87-4e02-b77c-b23535f4b943"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.504254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.503093    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-socket" pod "3fd74f30-bf87-4e02-b77c-b23535f4b943" (UID: "3fd74f30-bf87-4e02-b77c-b23535f4b943"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.504254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.503307    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-credential-socket" pod "92f2e69a-a921-4bcb-91bf-65144b3d2a7e" (UID: "92f2e69a-a921-4bcb-91bf-65144b3d2a7e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.504254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.503633    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-socket" pod "76d272c4-24c8-4ca8-8945-b72ccae3bdc8" (UID: "76d272c4-24c8-4ca8-8945-b72ccae3bdc8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.504254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.504005    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istiod-ca-cert" pod "76d272c4-24c8-4ca8-8945-b72ccae3bdc8" (UID: "76d272c4-24c8-4ca8-8945-b72ccae3bdc8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:42.513981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.512572    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-podinfo" pod "92f2e69a-a921-4bcb-91bf-65144b3d2a7e" (UID: "92f2e69a-a921-4bcb-91bf-65144b3d2a7e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:46:42.513981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.512692    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-kube-api-access-rn7bs" pod "3fd74f30-bf87-4e02-b77c-b23535f4b943" (UID: "3fd74f30-bf87-4e02-b77c-b23535f4b943"). InnerVolumeSpecName "kube-api-access-rn7bs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:42.518711 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.518500    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-kube-api-access-62dwv" pod "76d272c4-24c8-4ca8-8945-b72ccae3bdc8" (UID: "76d272c4-24c8-4ca8-8945-b72ccae3bdc8"). InnerVolumeSpecName "kube-api-access-62dwv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:42.518711 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.518600    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-envoy" pod "3fd74f30-bf87-4e02-b77c-b23535f4b943" (UID: "3fd74f30-bf87-4e02-b77c-b23535f4b943"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.518976 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.518947    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3fd74f30-bf87-4e02-b77c-b23535f4b943-istiod-ca-cert" pod "3fd74f30-bf87-4e02-b77c-b23535f4b943" (UID: "3fd74f30-bf87-4e02-b77c-b23535f4b943"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:46:42.519665 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.519093    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-certs" pod "92f2e69a-a921-4bcb-91bf-65144b3d2a7e" (UID: "92f2e69a-a921-4bcb-91bf-65144b3d2a7e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.520235 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.520115    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-data" pod "92f2e69a-a921-4bcb-91bf-65144b3d2a7e" (UID: "92f2e69a-a921-4bcb-91bf-65144b3d2a7e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.521325 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.520709    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-token" pod "92f2e69a-a921-4bcb-91bf-65144b3d2a7e" (UID: "92f2e69a-a921-4bcb-91bf-65144b3d2a7e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:42.521325 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.520837    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-token" pod "3fd74f30-bf87-4e02-b77c-b23535f4b943" (UID: "3fd74f30-bf87-4e02-b77c-b23535f4b943"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:42.521325 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.521075    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-data" pod "3fd74f30-bf87-4e02-b77c-b23535f4b943" (UID: "3fd74f30-bf87-4e02-b77c-b23535f4b943"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.521325 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.521092    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-credential-socket" pod "76d272c4-24c8-4ca8-8945-b72ccae3bdc8" (UID: "76d272c4-24c8-4ca8-8945-b72ccae3bdc8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.521325 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.521312    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-socket" pod "92f2e69a-a921-4bcb-91bf-65144b3d2a7e" (UID: "92f2e69a-a921-4bcb-91bf-65144b3d2a7e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.522375 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.522006    5039 generic.go:356] "Generic (PLEG): container finished" podID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerID="4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565" exitCode=0
Oct 31 07:46:42.522375 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.522063    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"
Oct 31 07:46:42.522375 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.522148    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" event={"ID":"db9040a4-bc18-4188-908c-1f3a4b2f97cd","Type":"ContainerDied","Data":"4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565"}
Oct 31 07:46:42.522375 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.522202    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd" event={"ID":"db9040a4-bc18-4188-908c-1f3a4b2f97cd","Type":"ContainerDied","Data":"34c82f0999c68e55c229c8bbdd3d2c8c0436524210b85dbdaab6c6d7c36b9e55"}
Oct 31 07:46:42.522375 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.522236    5039 scope.go:122] "RemoveContainer" containerID="4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565"
Oct 31 07:46:42.522892 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.522762    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-podinfo" pod "76d272c4-24c8-4ca8-8945-b72ccae3bdc8" (UID: "76d272c4-24c8-4ca8-8945-b72ccae3bdc8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:46:42.522892 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.522856    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-kube-api-access-z4gbr" pod "92f2e69a-a921-4bcb-91bf-65144b3d2a7e" (UID: "92f2e69a-a921-4bcb-91bf-65144b3d2a7e"). InnerVolumeSpecName "kube-api-access-z4gbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:42.528083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.527513    5039 generic.go:356] "Generic (PLEG): container finished" podID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerID="00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685" exitCode=0
Oct 31 07:46:42.528083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.527635    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" event={"ID":"76d272c4-24c8-4ca8-8945-b72ccae3bdc8","Type":"ContainerDied","Data":"00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685"}
Oct 31 07:46:42.528083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.527684    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw" event={"ID":"76d272c4-24c8-4ca8-8945-b72ccae3bdc8","Type":"ContainerDied","Data":"add2673903fbf8b3e61e3a8772cbd315844137e149b8cef6e0f5f20fd01ec78f"}
Oct 31 07:46:42.528083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.527782    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"
Oct 31 07:46:42.533812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.531603    5039 generic.go:356] "Generic (PLEG): container finished" podID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerID="897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d" exitCode=0
Oct 31 07:46:42.533812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.531705    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" event={"ID":"3fd74f30-bf87-4e02-b77c-b23535f4b943","Type":"ContainerDied","Data":"897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d"}
Oct 31 07:46:42.533812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.531736    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"
Oct 31 07:46:42.533812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.531751    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9" event={"ID":"3fd74f30-bf87-4e02-b77c-b23535f4b943","Type":"ContainerDied","Data":"31629935c544ac41bca775b8dde93409b0fa5fb09ad2d2265877be5734929330"}
Oct 31 07:46:42.533812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.533427    5039 generic.go:356] "Generic (PLEG): container finished" podID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerID="447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82" exitCode=0
Oct 31 07:46:42.533812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.533486    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" event={"ID":"92f2e69a-a921-4bcb-91bf-65144b3d2a7e","Type":"ContainerDied","Data":"447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82"}
Oct 31 07:46:42.533812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.533522    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6" event={"ID":"92f2e69a-a921-4bcb-91bf-65144b3d2a7e","Type":"ContainerDied","Data":"37d98550af308a3f1414ca8603f76395f7fd1049b0c48f8ae5754f9124516f57"}
Oct 31 07:46:42.533812 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.533593    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"
Oct 31 07:46:42.537312 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.537272    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-envoy" pod "76d272c4-24c8-4ca8-8945-b72ccae3bdc8" (UID: "76d272c4-24c8-4ca8-8945-b72ccae3bdc8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.537548 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.537528    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-token" pod "76d272c4-24c8-4ca8-8945-b72ccae3bdc8" (UID: "76d272c4-24c8-4ca8-8945-b72ccae3bdc8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:46:42.537868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.537799    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-envoy" pod "92f2e69a-a921-4bcb-91bf-65144b3d2a7e" (UID: "92f2e69a-a921-4bcb-91bf-65144b3d2a7e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:46:42.538271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.538237    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-podinfo" pod "3fd74f30-bf87-4e02-b77c-b23535f4b943" (UID: "3fd74f30-bf87-4e02-b77c-b23535f4b943"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 07:46:42.550160 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.548453    5039 scope.go:122] "RemoveContainer" containerID="4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565"
Oct 31 07:46:42.550160 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:42.548896    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565\": container with ID starting with 4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565 not found: ID does not exist" containerID="4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565"
Oct 31 07:46:42.550160 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.548966    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565"} err="failed to get container status \"4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565\": rpc error: code = NotFound desc = could not find container \"4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565\": container with ID starting with 4eb5e457a70b290825ca1cac1bfe5a6345e8982560a7c37172ff29443a2c4565 not found: ID does not exist"
Oct 31 07:46:42.550160 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.548990    5039 scope.go:122] "RemoveContainer" containerID="00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685"
Oct 31 07:46:42.566853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.566829    5039 scope.go:122] "RemoveContainer" containerID="00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685"
Oct 31 07:46:42.567239 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:42.567212    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685\": container with ID starting with 00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685 not found: ID does not exist" containerID="00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685"
Oct 31 07:46:42.567352 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.567254    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685"} err="failed to get container status \"00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685\": rpc error: code = NotFound desc = could not find container \"00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685\": container with ID starting with 00cb55f8c902bcca2fe2049b3306b5bb92bfd8811a8dfa2d0e392c405955f685 not found: ID does not exist"
Oct 31 07:46:42.567352 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.567281    5039 scope.go:122] "RemoveContainer" containerID="897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d"
Oct 31 07:46:42.581935 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.581890    5039 scope.go:122] "RemoveContainer" containerID="897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d"
Oct 31 07:46:42.582471 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:42.582424    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d\": container with ID starting with 897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d not found: ID does not exist" containerID="897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d"
Oct 31 07:46:42.582608 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.582468    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d"} err="failed to get container status \"897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d\": rpc error: code = NotFound desc = could not find container \"897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d\": container with ID starting with 897883ee2bf0ced2dbfd4e16acc8409c3876e86c7aa60a26ef051db4ffe28c2d not found: ID does not exist"
Oct 31 07:46:42.582608 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.582501    5039 scope.go:122] "RemoveContainer" containerID="447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82"
Oct 31 07:46:42.610043 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610007    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610043 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610041    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610055    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610069    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn7bs\" (UniqueName: \"kubernetes.io/projected/3fd74f30-bf87-4e02-b77c-b23535f4b943-kube-api-access-rn7bs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610084    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610098    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610110    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610122    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3fd74f30-bf87-4e02-b77c-b23535f4b943-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610135    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610147    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610160    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610172    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610184    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610197    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4gbr\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-kube-api-access-z4gbr\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610209    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610221    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610232    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610247    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610259    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62dwv\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-kube-api-access-62dwv\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610271    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610285    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610298    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3fd74f30-bf87-4e02-b77c-b23535f4b943-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610309    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610322    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76d272c4-24c8-4ca8-8945-b72ccae3bdc8-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.610703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.610333    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92f2e69a-a921-4bcb-91bf-65144b3d2a7e-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:46:42.612966 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.612934    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"]
Oct 31 07:46:42.617252 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.617218    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-52msd"]
Oct 31 07:46:42.618745 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.618719    5039 scope.go:122] "RemoveContainer" containerID="447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82"
Oct 31 07:46:42.619176 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:42.619146    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82\": container with ID starting with 447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82 not found: ID does not exist" containerID="447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82"
Oct 31 07:46:42.619296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.619189    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82"} err="failed to get container status \"447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82\": rpc error: code = NotFound desc = could not find container \"447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82\": container with ID starting with 447b96d75f95739eb41c3e49456418d05aa4443a100c6b19d44d42abaf89fc82 not found: ID does not exist"
Oct 31 07:46:42.885858 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.885817    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"]
Oct 31 07:46:42.891135 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.891098    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-sbdvw"]
Oct 31 07:46:42.901797 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.901743    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:42.924141 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.924100    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"]
Oct 31 07:46:42.928593 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.928554    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-7czf6"]
Oct 31 07:46:42.985947 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:42.985197    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"]
Oct 31 07:46:43.008233 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:43.008149    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b4e8fd-openshift-default-55864b8599-8mhc9"]
Oct 31 07:46:43.113003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:43.111223    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:43.626427 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:43.626379    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" path="/var/lib/kubelet/pods/3fd74f30-bf87-4e02-b77c-b23535f4b943/volumes"
Oct 31 07:46:43.628404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:43.628375    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" path="/var/lib/kubelet/pods/76d272c4-24c8-4ca8-8945-b72ccae3bdc8/volumes"
Oct 31 07:46:43.629229 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:43.629205    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" path="/var/lib/kubelet/pods/92f2e69a-a921-4bcb-91bf-65144b3d2a7e/volumes"
Oct 31 07:46:43.630466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:43.630445    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" path="/var/lib/kubelet/pods/db9040a4-bc18-4188-908c-1f3a4b2f97cd/volumes"
Oct 31 07:46:44.564306 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:44.564257    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rxdnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:46:44.564596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:44.564559    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:46:44.750188 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:44.749343    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:44.941288 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:44.941197    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:45.241219 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:45.241189    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:50.611119 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:46:50.611040    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:46:58.696318 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:46:58.696278    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:47:04.468258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468221    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"]
Oct 31 07:47:04.468681 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468666    5039 cpu_manager.go:414] "containerMap: removing container" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy"
Oct 31 07:47:04.468720 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468681    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy"
Oct 31 07:47:04.468720 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468700    5039 cpu_manager.go:414] "containerMap: removing container" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy"
Oct 31 07:47:04.468720 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468705    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468727    5039 cpu_manager.go:414] "containerMap: removing container" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468734    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468741    5039 cpu_manager.go:414] "containerMap: removing container" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468746    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468753    5039 cpu_manager.go:414] "containerMap: removing container" podUID="f8491677-90c0-4878-ae1e-d7f8e86f1cc1" containerName="revoke-keys"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468757    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f8491677-90c0-4878-ae1e-d7f8e86f1cc1" containerName="revoke-keys"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468764    5039 cpu_manager.go:414] "containerMap: removing container" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468768    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468779    5039 cpu_manager.go:414] "containerMap: removing container" podUID="bfe41bf6-ece6-425f-a0d4-04da4159aee9" containerName="insights-gathering"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468783    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bfe41bf6-ece6-425f-a0d4-04da4159aee9" containerName="insights-gathering"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468791    5039 cpu_manager.go:414] "containerMap: removing container" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468798    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468808    5039 cpu_manager.go:414] "containerMap: removing container" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468813    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468821    5039 cpu_manager.go:414] "containerMap: removing container" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468826    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468839    5039 cpu_manager.go:414] "containerMap: removing container" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468843    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy"
Oct 31 07:47:04.468844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468852    5039 cpu_manager.go:414] "containerMap: removing container" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468857    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468983    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="76d272c4-24c8-4ca8-8945-b72ccae3bdc8" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.468995    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="bfe41bf6-ece6-425f-a0d4-04da4159aee9" containerName="insights-gathering"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469002    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="31be7050-993f-4d04-b410-ed54bebe5704" containerName="main"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469007    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="9be50c74-6e27-4c8c-a3ed-f1cdae35c303" containerName="main"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469013    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="32141a6a-3864-4ad1-92f5-ce680c399ebb" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469019    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469024    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="92f2e69a-a921-4bcb-91bf-65144b3d2a7e" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469030    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="db9040a4-bc18-4188-908c-1f3a4b2f97cd" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469039    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fd74f30-bf87-4e02-b77c-b23535f4b943" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469045    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="65df80c4-a26b-40c9-b38b-6a71b7935fb8" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469051    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="1381d0c5-4a0d-4f52-9588-e5011ea39747" containerName="istio-proxy"
Oct 31 07:47:04.469397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.469060    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="f8491677-90c0-4878-ae1e-d7f8e86f1cc1" containerName="revoke-keys"
Oct 31 07:47:04.472480 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.472460    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.486645 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.486617    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:47:04.489676 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.489651    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"]
Oct 31 07:47:04.498068 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.498045    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:47:04.545561 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.545529    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmrll\" (UniqueName: \"kubernetes.io/projected/c8178a25-0f89-4463-93fa-bbaf5998e5ab-kube-api-access-pmrll\") pod \"maas-api-revoke-sub-85237e45-klg8z\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.545768 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.545601    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-klg8z\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.545843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.545767    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-klg8z\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.646659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.646624    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-klg8z\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.646864 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.646733    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-klg8z\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.646864 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.646755    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmrll\" (UniqueName: \"kubernetes.io/projected/c8178a25-0f89-4463-93fa-bbaf5998e5ab-kube-api-access-pmrll\") pod \"maas-api-revoke-sub-85237e45-klg8z\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.647401 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.647376    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-85237e45-klg8z\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.649141 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.649118    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-xks-ca\") pod \"maas-api-revoke-sub-85237e45-klg8z\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.664984 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.664962    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmrll\" (UniqueName: \"kubernetes.io/projected/c8178a25-0f89-4463-93fa-bbaf5998e5ab-kube-api-access-pmrll\") pod \"maas-api-revoke-sub-85237e45-klg8z\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:04.786306 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:04.786212    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:05.085006 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:05.084900    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"]
Oct 31 07:47:05.088955 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:47:05.088900    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8178a25_0f89_4463_93fa_bbaf5998e5ab.slice/crio-16ef4aa9e4928b91119070990e9d7664e71cffb8c53354c34a4cfbd608e7ae70 WatchSource:0}: Error finding container 16ef4aa9e4928b91119070990e9d7664e71cffb8c53354c34a4cfbd608e7ae70: Status 404 returned error can't find the container with id 16ef4aa9e4928b91119070990e9d7664e71cffb8c53354c34a4cfbd608e7ae70
Oct 31 07:47:05.763686 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:05.763647    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z" event={"ID":"c8178a25-0f89-4463-93fa-bbaf5998e5ab","Type":"ContainerStarted","Data":"acff9323eaa20ee50f0b54ce65b010e279d6cf055e1ffa49ccf40c44901d16f1"}
Oct 31 07:47:05.764282 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:05.763703    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z" event={"ID":"c8178a25-0f89-4463-93fa-bbaf5998e5ab","Type":"ContainerStarted","Data":"16ef4aa9e4928b91119070990e9d7664e71cffb8c53354c34a4cfbd608e7ae70"}
Oct 31 07:47:05.801551 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:05.801338    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z" podStartSLOduration=1.801321585 podStartE2EDuration="1.801321585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:47:05.798594825 +0000 UTC m=+1140.327789500" watchObservedRunningTime="2026-10-31 07:47:05.801321585 +0000 UTC m=+1140.330516260"
Oct 31 07:47:06.773790 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:06.773745    5039 generic.go:356] "Generic (PLEG): container finished" podID="c8178a25-0f89-4463-93fa-bbaf5998e5ab" containerID="acff9323eaa20ee50f0b54ce65b010e279d6cf055e1ffa49ccf40c44901d16f1" exitCode=0
Oct 31 07:47:06.774232 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:06.773806    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z" event={"ID":"c8178a25-0f89-4463-93fa-bbaf5998e5ab","Type":"ContainerDied","Data":"acff9323eaa20ee50f0b54ce65b010e279d6cf055e1ffa49ccf40c44901d16f1"}
Oct 31 07:47:07.232073 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:07.232038    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:47:07.433536 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:07.433500    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:47:07.928767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:07.928733    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:07.973698 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:07.973663    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:47:08.081309 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.081203    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-xks-ca\") pod \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") "
Oct 31 07:47:08.081309 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.081272    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-openshift-ca\") pod \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") "
Oct 31 07:47:08.081581 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.081376    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8178a25-0f89-4463-93fa-bbaf5998e5ab-kube-api-access-pmrll\" (UniqueName: \"kubernetes.io/projected/c8178a25-0f89-4463-93fa-bbaf5998e5ab-kube-api-access-pmrll\") pod \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\" (UID: \"c8178a25-0f89-4463-93fa-bbaf5998e5ab\") "
Oct 31 07:47:08.081686 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.081661    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-openshift-ca" pod "c8178a25-0f89-4463-93fa-bbaf5998e5ab" (UID: "c8178a25-0f89-4463-93fa-bbaf5998e5ab"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:47:08.081802 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.081785    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:47:08.083560 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.083534    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8178a25-0f89-4463-93fa-bbaf5998e5ab-kube-api-access-pmrll" pod "c8178a25-0f89-4463-93fa-bbaf5998e5ab" (UID: "c8178a25-0f89-4463-93fa-bbaf5998e5ab"). InnerVolumeSpecName "kube-api-access-pmrll". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:47:08.083641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.083536    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-xks-ca" pod "c8178a25-0f89-4463-93fa-bbaf5998e5ab" (UID: "c8178a25-0f89-4463-93fa-bbaf5998e5ab"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:47:08.183005 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.182949    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/c8178a25-0f89-4463-93fa-bbaf5998e5ab-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:47:08.183005 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.182999    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pmrll\" (UniqueName: \"kubernetes.io/projected/c8178a25-0f89-4463-93fa-bbaf5998e5ab-kube-api-access-pmrll\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:47:08.786039 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.785998    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z" event={"ID":"c8178a25-0f89-4463-93fa-bbaf5998e5ab","Type":"ContainerDied","Data":"16ef4aa9e4928b91119070990e9d7664e71cffb8c53354c34a4cfbd608e7ae70"}
Oct 31 07:47:08.786039 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.786041    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"
Oct 31 07:47:08.786304 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:08.786051    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16ef4aa9e4928b91119070990e9d7664e71cffb8c53354c34a4cfbd608e7ae70"
Oct 31 07:47:16.019963 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:16.019931    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:47:18.075844 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:18.075806    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:47:26.978042 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:26.978008    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:47:28.696014 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:47:28.695975    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:47:49.417403 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:49.417364    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:47:50.121060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:47:50.121027    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:47:58.695955 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:47:58.695900    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:48:05.831164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:05.831124    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:48:05.833404 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:05.833382    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:48:05.843633 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:05.843605    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:48:05.845733 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:05.845710    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:48:07.424779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:07.424716    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:48:08.131866 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:08.131025    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:48:08.131866 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:08.131104    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:48:11.395277 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.395232    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"]
Oct 31 07:48:11.395796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.395675    5039 cpu_manager.go:414] "containerMap: removing container" podUID="c8178a25-0f89-4463-93fa-bbaf5998e5ab" containerName="revoke-keys"
Oct 31 07:48:11.395796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.395686    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8178a25-0f89-4463-93fa-bbaf5998e5ab" containerName="revoke-keys"
Oct 31 07:48:11.395796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.395786    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8178a25-0f89-4463-93fa-bbaf5998e5ab" containerName="revoke-keys"
Oct 31 07:48:11.399053 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.399032    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.414270 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.414242    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:48:11.425297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.425261    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-6fnpr\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.425466 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.425430    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdrqp\" (UniqueName: \"kubernetes.io/projected/3840a3c9-161e-44bf-920a-1646b17c2d77-kube-api-access-fdrqp\") pod \"maas-api-revoke-sub-c1e271a9-6fnpr\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.425540 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.425500    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-6fnpr\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.425623 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.425604    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:48:11.430051 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.430022    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"]
Oct 31 07:48:11.526693 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.526658    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-6fnpr\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.526886 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.526757    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdrqp\" (UniqueName: \"kubernetes.io/projected/3840a3c9-161e-44bf-920a-1646b17c2d77-kube-api-access-fdrqp\") pod \"maas-api-revoke-sub-c1e271a9-6fnpr\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.526886 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.526806    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-6fnpr\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.527541 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.527519    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-c1e271a9-6fnpr\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.529148 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.529124    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-xks-ca\") pod \"maas-api-revoke-sub-c1e271a9-6fnpr\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.547026 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.546994    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdrqp\" (UniqueName: \"kubernetes.io/projected/3840a3c9-161e-44bf-920a-1646b17c2d77-kube-api-access-fdrqp\") pod \"maas-api-revoke-sub-c1e271a9-6fnpr\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:11.712202 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:11.712170    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:12.010177 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:12.010097    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"]
Oct 31 07:48:12.014654 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:48:12.014625    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3840a3c9_161e_44bf_920a_1646b17c2d77.slice/crio-11c386c40ba14ea30970f775fe3906367b6b2b05c367b78f0cd48ac10f1db86f WatchSource:0}: Error finding container 11c386c40ba14ea30970f775fe3906367b6b2b05c367b78f0cd48ac10f1db86f: Status 404 returned error can't find the container with id 11c386c40ba14ea30970f775fe3906367b6b2b05c367b78f0cd48ac10f1db86f
Oct 31 07:48:12.169622 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:12.169581    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr" event={"ID":"3840a3c9-161e-44bf-920a-1646b17c2d77","Type":"ContainerStarted","Data":"11c386c40ba14ea30970f775fe3906367b6b2b05c367b78f0cd48ac10f1db86f"}
Oct 31 07:48:13.177139 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:13.177044    5039 generic.go:356] "Generic (PLEG): container finished" podID="3840a3c9-161e-44bf-920a-1646b17c2d77" containerID="d5ae5f26cbbb5e4986aa42842a1afa0d7b2068d5ff4353f75c9dff30cb19ccef" exitCode=0
Oct 31 07:48:13.177578 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:13.177139    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr" event={"ID":"3840a3c9-161e-44bf-920a-1646b17c2d77","Type":"ContainerDied","Data":"d5ae5f26cbbb5e4986aa42842a1afa0d7b2068d5ff4353f75c9dff30cb19ccef"}
Oct 31 07:48:14.331689 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.331659    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:14.356980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.356941    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-xks-ca\") pod \"3840a3c9-161e-44bf-920a-1646b17c2d77\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") "
Oct 31 07:48:14.357158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.356997    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3840a3c9-161e-44bf-920a-1646b17c2d77-kube-api-access-fdrqp\" (UniqueName: \"kubernetes.io/projected/3840a3c9-161e-44bf-920a-1646b17c2d77-kube-api-access-fdrqp\") pod \"3840a3c9-161e-44bf-920a-1646b17c2d77\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") "
Oct 31 07:48:14.357158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.357070    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-openshift-ca\") pod \"3840a3c9-161e-44bf-920a-1646b17c2d77\" (UID: \"3840a3c9-161e-44bf-920a-1646b17c2d77\") "
Oct 31 07:48:14.357417 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.357383    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-openshift-ca" pod "3840a3c9-161e-44bf-920a-1646b17c2d77" (UID: "3840a3c9-161e-44bf-920a-1646b17c2d77"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:48:14.357553 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.357486    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:48:14.359097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.359072    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-xks-ca" pod "3840a3c9-161e-44bf-920a-1646b17c2d77" (UID: "3840a3c9-161e-44bf-920a-1646b17c2d77"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:48:14.359097 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.359090    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3840a3c9-161e-44bf-920a-1646b17c2d77-kube-api-access-fdrqp" pod "3840a3c9-161e-44bf-920a-1646b17c2d77" (UID: "3840a3c9-161e-44bf-920a-1646b17c2d77"). InnerVolumeSpecName "kube-api-access-fdrqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:48:14.458262 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.458223    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/3840a3c9-161e-44bf-920a-1646b17c2d77-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:48:14.458262 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:14.458261    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdrqp\" (UniqueName: \"kubernetes.io/projected/3840a3c9-161e-44bf-920a-1646b17c2d77-kube-api-access-fdrqp\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:48:15.192732 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:15.192694    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"
Oct 31 07:48:15.192732 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:15.192724    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr" event={"ID":"3840a3c9-161e-44bf-920a-1646b17c2d77","Type":"ContainerDied","Data":"11c386c40ba14ea30970f775fe3906367b6b2b05c367b78f0cd48ac10f1db86f"}
Oct 31 07:48:15.192981 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:15.192775    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11c386c40ba14ea30970f775fe3906367b6b2b05c367b78f0cd48ac10f1db86f"
Oct 31 07:48:17.222693 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:17.222611    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:48:23.336028 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:23.335987    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:48:26.635938 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:26.635880    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:48:28.743649 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:48:28.743605    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:48:29.540078 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:29.540038    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rxdnz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:48:29.540258 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:29.540102    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:48:31.349972 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.349931    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"]
Oct 31 07:48:31.350390 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.350376    5039 cpu_manager.go:414] "containerMap: removing container" podUID="3840a3c9-161e-44bf-920a-1646b17c2d77" containerName="revoke-keys"
Oct 31 07:48:31.350443 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.350390    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3840a3c9-161e-44bf-920a-1646b17c2d77" containerName="revoke-keys"
Oct 31 07:48:31.350478 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.350453    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="3840a3c9-161e-44bf-920a-1646b17c2d77" containerName="revoke-keys"
Oct 31 07:48:31.353646 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.353623    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.371826 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.371797    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"]
Oct 31 07:48:31.380207 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.380165    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:48:31.380366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.380248    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:48:31.453739 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.453701    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-vxzlr\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.453966 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.453754    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-vxzlr\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.453966 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.453778    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lswvc\" (UniqueName: \"kubernetes.io/projected/9ea4e346-f0c3-4436-a959-dadb7cc793b7-kube-api-access-lswvc\") pod \"maas-api-revoke-sub-2e1f5b5f-vxzlr\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.554609 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.554522    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-vxzlr\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.554609 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.554569    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lswvc\" (UniqueName: \"kubernetes.io/projected/9ea4e346-f0c3-4436-a959-dadb7cc793b7-kube-api-access-lswvc\") pod \"maas-api-revoke-sub-2e1f5b5f-vxzlr\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.554874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.554650    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-vxzlr\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.555331 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.555301    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-vxzlr\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.557188 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.557167    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2e1f5b5f-vxzlr\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.572980 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.572952    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lswvc\" (UniqueName: \"kubernetes.io/projected/9ea4e346-f0c3-4436-a959-dadb7cc793b7-kube-api-access-lswvc\") pod \"maas-api-revoke-sub-2e1f5b5f-vxzlr\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.666518 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.666425    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:31.964935 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:31.964867    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"]
Oct 31 07:48:31.969631 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:48:31.969601    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea4e346_f0c3_4436_a959_dadb7cc793b7.slice/crio-f983c425f5d44e683d5cc0e94452cfc6582f13bb79611aea3d0ddbee848f00f2 WatchSource:0}: Error finding container f983c425f5d44e683d5cc0e94452cfc6582f13bb79611aea3d0ddbee848f00f2: Status 404 returned error can't find the container with id f983c425f5d44e683d5cc0e94452cfc6582f13bb79611aea3d0ddbee848f00f2
Oct 31 07:48:32.332681 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:32.332643    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr" event={"ID":"9ea4e346-f0c3-4436-a959-dadb7cc793b7","Type":"ContainerStarted","Data":"f983c425f5d44e683d5cc0e94452cfc6582f13bb79611aea3d0ddbee848f00f2"}
Oct 31 07:48:33.340817 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:33.340776    5039 generic.go:356] "Generic (PLEG): container finished" podID="9ea4e346-f0c3-4436-a959-dadb7cc793b7" containerID="a6b9305bd23df2dcdf77d71e0a0d85e49a09a599da12d423ee90a0ea29a06d92" exitCode=0
Oct 31 07:48:33.341252 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:33.340862    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr" event={"ID":"9ea4e346-f0c3-4436-a959-dadb7cc793b7","Type":"ContainerDied","Data":"a6b9305bd23df2dcdf77d71e0a0d85e49a09a599da12d423ee90a0ea29a06d92"}
Oct 31 07:48:34.485110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.485072    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:34.593256 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.593214    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-xks-ca\") pod \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") "
Oct 31 07:48:34.593470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.593301    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9ea4e346-f0c3-4436-a959-dadb7cc793b7-kube-api-access-lswvc\" (UniqueName: \"kubernetes.io/projected/9ea4e346-f0c3-4436-a959-dadb7cc793b7-kube-api-access-lswvc\") pod \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") "
Oct 31 07:48:34.593470 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.593323    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-openshift-ca\") pod \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\" (UID: \"9ea4e346-f0c3-4436-a959-dadb7cc793b7\") "
Oct 31 07:48:34.593738 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.593711    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-openshift-ca" pod "9ea4e346-f0c3-4436-a959-dadb7cc793b7" (UID: "9ea4e346-f0c3-4436-a959-dadb7cc793b7"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:48:34.595514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.595481    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea4e346-f0c3-4436-a959-dadb7cc793b7-kube-api-access-lswvc" pod "9ea4e346-f0c3-4436-a959-dadb7cc793b7" (UID: "9ea4e346-f0c3-4436-a959-dadb7cc793b7"). InnerVolumeSpecName "kube-api-access-lswvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:48:34.595607 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.595505    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-xks-ca" pod "9ea4e346-f0c3-4436-a959-dadb7cc793b7" (UID: "9ea4e346-f0c3-4436-a959-dadb7cc793b7"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:48:34.695112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.695070    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:48:34.695112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.695110    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lswvc\" (UniqueName: \"kubernetes.io/projected/9ea4e346-f0c3-4436-a959-dadb7cc793b7-kube-api-access-lswvc\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:48:34.695317 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:34.695124    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/9ea4e346-f0c3-4436-a959-dadb7cc793b7-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:48:35.354335 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:35.354302    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"
Oct 31 07:48:35.354550 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:35.354342    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr" event={"ID":"9ea4e346-f0c3-4436-a959-dadb7cc793b7","Type":"ContainerDied","Data":"f983c425f5d44e683d5cc0e94452cfc6582f13bb79611aea3d0ddbee848f00f2"}
Oct 31 07:48:35.354550 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:35.354397    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f983c425f5d44e683d5cc0e94452cfc6582f13bb79611aea3d0ddbee848f00f2"
Oct 31 07:48:42.572766 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.572725    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"]
Oct 31 07:48:42.573314 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.573294    5039 cpu_manager.go:414] "containerMap: removing container" podUID="9ea4e346-f0c3-4436-a959-dadb7cc793b7" containerName="revoke-keys"
Oct 31 07:48:42.573314 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.573315    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9ea4e346-f0c3-4436-a959-dadb7cc793b7" containerName="revoke-keys"
Oct 31 07:48:42.573426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.573395    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="9ea4e346-f0c3-4436-a959-dadb7cc793b7" containerName="revoke-keys"
Oct 31 07:48:42.576693 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.576675    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.593937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.593882    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:48:42.593937 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.593889    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:48:42.595252 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.595228    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"]
Oct 31 07:48:42.670991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.670838    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ec843018-szqzd\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.670991 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.670885    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ec843018-szqzd\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.671271 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.671136    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmj5p\" (UniqueName: \"kubernetes.io/projected/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-kube-api-access-wmj5p\") pod \"maas-api-revoke-sub-ec843018-szqzd\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.771692 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.771651    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ec843018-szqzd\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.771692 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.771692    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ec843018-szqzd\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.771910 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.771734    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmj5p\" (UniqueName: \"kubernetes.io/projected/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-kube-api-access-wmj5p\") pod \"maas-api-revoke-sub-ec843018-szqzd\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.772377 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.772356    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ec843018-szqzd\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.774265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.774241    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ec843018-szqzd\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.790581 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.790549    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmj5p\" (UniqueName: \"kubernetes.io/projected/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-kube-api-access-wmj5p\") pod \"maas-api-revoke-sub-ec843018-szqzd\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:42.890269 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:42.890147    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:43.212633 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:43.212601    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"]
Oct 31 07:48:43.216407 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:48:43.216378    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a88d254_466e_4d45_b0d4_dd5ed66a76f1.slice/crio-8424ba9e8a6d870f1385a02bd414bbc6781479fed01f09e031b10a5f9ff53b42 WatchSource:0}: Error finding container 8424ba9e8a6d870f1385a02bd414bbc6781479fed01f09e031b10a5f9ff53b42: Status 404 returned error can't find the container with id 8424ba9e8a6d870f1385a02bd414bbc6781479fed01f09e031b10a5f9ff53b42
Oct 31 07:48:43.402241 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:43.402206    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd" event={"ID":"1a88d254-466e-4d45-b0d4-dd5ed66a76f1","Type":"ContainerStarted","Data":"8424ba9e8a6d870f1385a02bd414bbc6781479fed01f09e031b10a5f9ff53b42"}
Oct 31 07:48:44.410426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:44.410326    5039 generic.go:356] "Generic (PLEG): container finished" podID="1a88d254-466e-4d45-b0d4-dd5ed66a76f1" containerID="2b662c602254904727b4d8eb1e58d1cb2899d0cba8b4af73138cc2249458ecde" exitCode=0
Oct 31 07:48:44.410426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:44.410412    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd" event={"ID":"1a88d254-466e-4d45-b0d4-dd5ed66a76f1","Type":"ContainerDied","Data":"2b662c602254904727b4d8eb1e58d1cb2899d0cba8b4af73138cc2249458ecde"}
Oct 31 07:48:45.556975 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.556938    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:45.600793 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.600757    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-xks-ca\") pod \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") "
Oct 31 07:48:45.600995 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.600821    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-kube-api-access-wmj5p\" (UniqueName: \"kubernetes.io/projected/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-kube-api-access-wmj5p\") pod \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") "
Oct 31 07:48:45.600995 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.600985    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-openshift-ca\") pod \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\" (UID: \"1a88d254-466e-4d45-b0d4-dd5ed66a76f1\") "
Oct 31 07:48:45.601384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.601352    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-openshift-ca" pod "1a88d254-466e-4d45-b0d4-dd5ed66a76f1" (UID: "1a88d254-466e-4d45-b0d4-dd5ed66a76f1"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:48:45.603077 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.603026    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-xks-ca" pod "1a88d254-466e-4d45-b0d4-dd5ed66a76f1" (UID: "1a88d254-466e-4d45-b0d4-dd5ed66a76f1"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:48:45.603183 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.603142    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-kube-api-access-wmj5p" pod "1a88d254-466e-4d45-b0d4-dd5ed66a76f1" (UID: "1a88d254-466e-4d45-b0d4-dd5ed66a76f1"). InnerVolumeSpecName "kube-api-access-wmj5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:48:45.703115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.702988    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:48:45.703115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.703029    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:48:45.703115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:45.703045    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmj5p\" (UniqueName: \"kubernetes.io/projected/1a88d254-466e-4d45-b0d4-dd5ed66a76f1-kube-api-access-wmj5p\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:48:46.426699 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:46.426664    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"
Oct 31 07:48:46.426876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:46.426703    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd" event={"ID":"1a88d254-466e-4d45-b0d4-dd5ed66a76f1","Type":"ContainerDied","Data":"8424ba9e8a6d870f1385a02bd414bbc6781479fed01f09e031b10a5f9ff53b42"}
Oct 31 07:48:46.426876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:48:46.426759    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8424ba9e8a6d870f1385a02bd414bbc6781479fed01f09e031b10a5f9ff53b42"
Oct 31 07:48:58.696805 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:48:58.696763    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:49:07.531339 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:07.531299    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:49:26.744112 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:26.744075    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:49:28.696349 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:49:28.696311    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:49:30.205622 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.205580    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"]
Oct 31 07:49:30.206091 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.206074    5039 cpu_manager.go:414] "containerMap: removing container" podUID="1a88d254-466e-4d45-b0d4-dd5ed66a76f1" containerName="revoke-keys"
Oct 31 07:49:30.206141 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.206094    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a88d254-466e-4d45-b0d4-dd5ed66a76f1" containerName="revoke-keys"
Oct 31 07:49:30.206190 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.206177    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a88d254-466e-4d45-b0d4-dd5ed66a76f1" containerName="revoke-keys"
Oct 31 07:49:30.209428 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.209408    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.225085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.225053    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:49:30.225085 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.225081    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:49:30.240931 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.240886    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"]
Oct 31 07:49:30.338015 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.337973    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-p49k5\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.338195 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.338136    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hdhm\" (UniqueName: \"kubernetes.io/projected/83eade2d-cc05-4239-841d-bea52b4dd668-kube-api-access-5hdhm\") pod \"maas-api-revoke-sub-046e1343-p49k5\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.338195 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.338167    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-p49k5\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.438925 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.438885    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hdhm\" (UniqueName: \"kubernetes.io/projected/83eade2d-cc05-4239-841d-bea52b4dd668-kube-api-access-5hdhm\") pod \"maas-api-revoke-sub-046e1343-p49k5\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.439089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.438979    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-p49k5\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.439089 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.439049    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-p49k5\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.439779 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.439743    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-046e1343-p49k5\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.441469 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.441443    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-xks-ca\") pod \"maas-api-revoke-sub-046e1343-p49k5\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.457374 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.457310    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hdhm\" (UniqueName: \"kubernetes.io/projected/83eade2d-cc05-4239-841d-bea52b4dd668-kube-api-access-5hdhm\") pod \"maas-api-revoke-sub-046e1343-p49k5\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.523061 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.523023    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:30.818588 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:30.818508    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"]
Oct 31 07:49:30.822624 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:49:30.822595    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83eade2d_cc05_4239_841d_bea52b4dd668.slice/crio-0bba88553444a2c7b82f5d731a656627dac8603da162aa5d865a0b4c1c98562d WatchSource:0}: Error finding container 0bba88553444a2c7b82f5d731a656627dac8603da162aa5d865a0b4c1c98562d: Status 404 returned error can't find the container with id 0bba88553444a2c7b82f5d731a656627dac8603da162aa5d865a0b4c1c98562d
Oct 31 07:49:31.709308 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:31.709273    5039 generic.go:356] "Generic (PLEG): container finished" podID="83eade2d-cc05-4239-841d-bea52b4dd668" containerID="69634f29422f8d08ba948d86acad6726fbfa8bc1618f0d5bf4a91d5ea39c6143" exitCode=0
Oct 31 07:49:31.709308 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:31.709314    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5" event={"ID":"83eade2d-cc05-4239-841d-bea52b4dd668","Type":"ContainerDied","Data":"69634f29422f8d08ba948d86acad6726fbfa8bc1618f0d5bf4a91d5ea39c6143"}
Oct 31 07:49:31.709725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:31.709350    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5" event={"ID":"83eade2d-cc05-4239-841d-bea52b4dd668","Type":"ContainerStarted","Data":"0bba88553444a2c7b82f5d731a656627dac8603da162aa5d865a0b4c1c98562d"}
Oct 31 07:49:32.853858 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:32.853830    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:32.968498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:32.968414    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-openshift-ca\") pod \"83eade2d-cc05-4239-841d-bea52b4dd668\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") "
Oct 31 07:49:32.968498 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:32.968489    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-xks-ca\") pod \"83eade2d-cc05-4239-841d-bea52b4dd668\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") "
Oct 31 07:49:32.968701 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:32.968512    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/83eade2d-cc05-4239-841d-bea52b4dd668-kube-api-access-5hdhm\" (UniqueName: \"kubernetes.io/projected/83eade2d-cc05-4239-841d-bea52b4dd668-kube-api-access-5hdhm\") pod \"83eade2d-cc05-4239-841d-bea52b4dd668\" (UID: \"83eade2d-cc05-4239-841d-bea52b4dd668\") "
Oct 31 07:49:32.968876 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:32.968837    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-openshift-ca" pod "83eade2d-cc05-4239-841d-bea52b4dd668" (UID: "83eade2d-cc05-4239-841d-bea52b4dd668"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:49:32.970710 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:32.970681    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-xks-ca" pod "83eade2d-cc05-4239-841d-bea52b4dd668" (UID: "83eade2d-cc05-4239-841d-bea52b4dd668"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:49:32.970710 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:32.970688    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83eade2d-cc05-4239-841d-bea52b4dd668-kube-api-access-5hdhm" pod "83eade2d-cc05-4239-841d-bea52b4dd668" (UID: "83eade2d-cc05-4239-841d-bea52b4dd668"). InnerVolumeSpecName "kube-api-access-5hdhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:49:33.069565 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:33.069523    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:49:33.069565 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:33.069558    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hdhm\" (UniqueName: \"kubernetes.io/projected/83eade2d-cc05-4239-841d-bea52b4dd668-kube-api-access-5hdhm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:49:33.069565 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:33.069568    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/83eade2d-cc05-4239-841d-bea52b4dd668-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:49:33.722427 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:33.722387    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5" event={"ID":"83eade2d-cc05-4239-841d-bea52b4dd668","Type":"ContainerDied","Data":"0bba88553444a2c7b82f5d731a656627dac8603da162aa5d865a0b4c1c98562d"}
Oct 31 07:49:33.722427 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:33.722424    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"
Oct 31 07:49:33.722641 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:33.722449    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0bba88553444a2c7b82f5d731a656627dac8603da162aa5d865a0b4c1c98562d"
Oct 31 07:49:37.198188 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:37.198154    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:49:40.529107 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.529068    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"]
Oct 31 07:49:40.529545 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.529508    5039 cpu_manager.go:414] "containerMap: removing container" podUID="83eade2d-cc05-4239-841d-bea52b4dd668" containerName="revoke-keys"
Oct 31 07:49:40.529545 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.529519    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="83eade2d-cc05-4239-841d-bea52b4dd668" containerName="revoke-keys"
Oct 31 07:49:40.529633 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.529598    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="83eade2d-cc05-4239-841d-bea52b4dd668" containerName="revoke-keys"
Oct 31 07:49:40.532996 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.532979    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.552027 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.551999    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"]
Oct 31 07:49:40.559511 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.559468    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:49:40.559787 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.559758    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:49:40.640071 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.640032    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xw2r\" (UniqueName: \"kubernetes.io/projected/483f5532-28d0-42bb-98bb-0f5ebc1e2169-kube-api-access-9xw2r\") pod \"maas-api-revoke-sub-d3fba056-46xh5\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.640254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.640095    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-46xh5\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.640254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.640232    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-46xh5\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.740865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.740831    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-46xh5\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.741066 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.740937    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-46xh5\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.741066 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.741046    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xw2r\" (UniqueName: \"kubernetes.io/projected/483f5532-28d0-42bb-98bb-0f5ebc1e2169-kube-api-access-9xw2r\") pod \"maas-api-revoke-sub-d3fba056-46xh5\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.741580 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.741549    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-d3fba056-46xh5\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.743297 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.743277    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-xks-ca\") pod \"maas-api-revoke-sub-d3fba056-46xh5\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.759077 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.759044    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xw2r\" (UniqueName: \"kubernetes.io/projected/483f5532-28d0-42bb-98bb-0f5ebc1e2169-kube-api-access-9xw2r\") pod \"maas-api-revoke-sub-d3fba056-46xh5\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:40.846070 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:40.845981    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:41.143796 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:41.143757    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"]
Oct 31 07:49:41.147009 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:49:41.146905    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483f5532_28d0_42bb_98bb_0f5ebc1e2169.slice/crio-c27e95d487866493e937720839ca606f790bd398ab1f1b0345435b322b8e0869 WatchSource:0}: Error finding container c27e95d487866493e937720839ca606f790bd398ab1f1b0345435b322b8e0869: Status 404 returned error can't find the container with id c27e95d487866493e937720839ca606f790bd398ab1f1b0345435b322b8e0869
Oct 31 07:49:41.796254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:41.796164    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5" event={"ID":"483f5532-28d0-42bb-98bb-0f5ebc1e2169","Type":"ContainerStarted","Data":"e243fc5944a6694af393d36ab82663a4048d82efced4c7551c86a1c03e0aced7"}
Oct 31 07:49:41.796254 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:41.796249    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5" event={"ID":"483f5532-28d0-42bb-98bb-0f5ebc1e2169","Type":"ContainerStarted","Data":"c27e95d487866493e937720839ca606f790bd398ab1f1b0345435b322b8e0869"}
Oct 31 07:49:41.832819 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:41.832766    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5" podStartSLOduration=1.832753069 podStartE2EDuration="1.832753069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:49:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:49:41.831738372 +0000 UTC m=+1296.360933048" watchObservedRunningTime="2026-10-31 07:49:41.832753069 +0000 UTC m=+1296.361947742"
Oct 31 07:49:42.821292 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:42.821059    5039 generic.go:356] "Generic (PLEG): container finished" podID="483f5532-28d0-42bb-98bb-0f5ebc1e2169" containerID="e243fc5944a6694af393d36ab82663a4048d82efced4c7551c86a1c03e0aced7" exitCode=0
Oct 31 07:49:42.821292 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:42.821222    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5" event={"ID":"483f5532-28d0-42bb-98bb-0f5ebc1e2169","Type":"ContainerDied","Data":"e243fc5944a6694af393d36ab82663a4048d82efced4c7551c86a1c03e0aced7"}
Oct 31 07:49:44.238639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.238610    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:44.329786 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.329754    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-xks-ca\") pod \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") "
Oct 31 07:49:44.329997 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.329866    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/483f5532-28d0-42bb-98bb-0f5ebc1e2169-kube-api-access-9xw2r\" (UniqueName: \"kubernetes.io/projected/483f5532-28d0-42bb-98bb-0f5ebc1e2169-kube-api-access-9xw2r\") pod \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") "
Oct 31 07:49:44.329997 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.329939    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-openshift-ca\") pod \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\" (UID: \"483f5532-28d0-42bb-98bb-0f5ebc1e2169\") "
Oct 31 07:49:44.330468 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.330437    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-openshift-ca" pod "483f5532-28d0-42bb-98bb-0f5ebc1e2169" (UID: "483f5532-28d0-42bb-98bb-0f5ebc1e2169"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:49:44.332082 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.332059    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-xks-ca" pod "483f5532-28d0-42bb-98bb-0f5ebc1e2169" (UID: "483f5532-28d0-42bb-98bb-0f5ebc1e2169"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:49:44.332500 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.332476    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/483f5532-28d0-42bb-98bb-0f5ebc1e2169-kube-api-access-9xw2r" pod "483f5532-28d0-42bb-98bb-0f5ebc1e2169" (UID: "483f5532-28d0-42bb-98bb-0f5ebc1e2169"). InnerVolumeSpecName "kube-api-access-9xw2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:49:44.431763 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.431668    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:49:44.431763 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.431704    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xw2r\" (UniqueName: \"kubernetes.io/projected/483f5532-28d0-42bb-98bb-0f5ebc1e2169-kube-api-access-9xw2r\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:49:44.431763 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.431714    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/483f5532-28d0-42bb-98bb-0f5ebc1e2169-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:49:44.843459 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.843424    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"
Oct 31 07:49:44.843611 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.843461    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5" event={"ID":"483f5532-28d0-42bb-98bb-0f5ebc1e2169","Type":"ContainerDied","Data":"c27e95d487866493e937720839ca606f790bd398ab1f1b0345435b322b8e0869"}
Oct 31 07:49:44.843611 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:44.843511    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c27e95d487866493e937720839ca606f790bd398ab1f1b0345435b322b8e0869"
Oct 31 07:49:53.273505 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:53.273383    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:49:53.458316 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:49:53.458284    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:49:58.745838 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:49:58.745797    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:50:02.139620 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.139582    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"]
Oct 31 07:50:02.140079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.140064    5039 cpu_manager.go:414] "containerMap: removing container" podUID="483f5532-28d0-42bb-98bb-0f5ebc1e2169" containerName="revoke-keys"
Oct 31 07:50:02.140079 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.140080    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="483f5532-28d0-42bb-98bb-0f5ebc1e2169" containerName="revoke-keys"
Oct 31 07:50:02.140196 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.140187    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="483f5532-28d0-42bb-98bb-0f5ebc1e2169" containerName="revoke-keys"
Oct 31 07:50:02.143574 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.143557    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.164811 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.164777    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"]
Oct 31 07:50:02.170083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.170052    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:50:02.170378 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.170197    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:50:02.210578 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.210541    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-m2558\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.210752 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.210604    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-m2558\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.210752 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.210704    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b9x8\" (UniqueName: \"kubernetes.io/projected/1dede7b7-5895-415d-82b4-3808dae8178c-kube-api-access-8b9x8\") pod \"maas-api-revoke-sub-ae594979-m2558\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.312029 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.311992    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-m2558\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.312212 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.312060    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-m2558\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.312212 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.312097    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b9x8\" (UniqueName: \"kubernetes.io/projected/1dede7b7-5895-415d-82b4-3808dae8178c-kube-api-access-8b9x8\") pod \"maas-api-revoke-sub-ae594979-m2558\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.312756 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.312725    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-ae594979-m2558\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.314627 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.314601    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-ae594979-m2558\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.330276 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.330250    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b9x8\" (UniqueName: \"kubernetes.io/projected/1dede7b7-5895-415d-82b4-3808dae8178c-kube-api-access-8b9x8\") pod \"maas-api-revoke-sub-ae594979-m2558\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.456707 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.456674    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:02.753784 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.753707    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"]
Oct 31 07:50:02.757562 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:50:02.757530    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dede7b7_5895_415d_82b4_3808dae8178c.slice/crio-edbea1a9b83609b64325603b5c548097317829f1e6b45298853e9496fb0f7fd5 WatchSource:0}: Error finding container edbea1a9b83609b64325603b5c548097317829f1e6b45298853e9496fb0f7fd5: Status 404 returned error can't find the container with id edbea1a9b83609b64325603b5c548097317829f1e6b45298853e9496fb0f7fd5
Oct 31 07:50:02.960772 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:02.960731    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558" event={"ID":"1dede7b7-5895-415d-82b4-3808dae8178c","Type":"ContainerStarted","Data":"edbea1a9b83609b64325603b5c548097317829f1e6b45298853e9496fb0f7fd5"}
Oct 31 07:50:03.969568 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:03.969535    5039 generic.go:356] "Generic (PLEG): container finished" podID="1dede7b7-5895-415d-82b4-3808dae8178c" containerID="676e9abfaddcba1da5be7132382ec5efd067ff6d3d6f01dcabd3c67ef9d08bbe" exitCode=0
Oct 31 07:50:03.969999 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:03.969623    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558" event={"ID":"1dede7b7-5895-415d-82b4-3808dae8178c","Type":"ContainerDied","Data":"676e9abfaddcba1da5be7132382ec5efd067ff6d3d6f01dcabd3c67ef9d08bbe"}
Oct 31 07:50:05.116932 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.116885    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:05.141905 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.141869    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1dede7b7-5895-415d-82b4-3808dae8178c-kube-api-access-8b9x8\" (UniqueName: \"kubernetes.io/projected/1dede7b7-5895-415d-82b4-3808dae8178c-kube-api-access-8b9x8\") pod \"1dede7b7-5895-415d-82b4-3808dae8178c\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") "
Oct 31 07:50:05.142083 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.141961    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-openshift-ca\") pod \"1dede7b7-5895-415d-82b4-3808dae8178c\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") "
Oct 31 07:50:05.142126 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.142077    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-xks-ca\") pod \"1dede7b7-5895-415d-82b4-3808dae8178c\" (UID: \"1dede7b7-5895-415d-82b4-3808dae8178c\") "
Oct 31 07:50:05.142392 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.142366    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-openshift-ca" pod "1dede7b7-5895-415d-82b4-3808dae8178c" (UID: "1dede7b7-5895-415d-82b4-3808dae8178c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:50:05.144052 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.144031    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dede7b7-5895-415d-82b4-3808dae8178c-kube-api-access-8b9x8" pod "1dede7b7-5895-415d-82b4-3808dae8178c" (UID: "1dede7b7-5895-415d-82b4-3808dae8178c"). InnerVolumeSpecName "kube-api-access-8b9x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:50:05.144301 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.144273    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-xks-ca" pod "1dede7b7-5895-415d-82b4-3808dae8178c" (UID: "1dede7b7-5895-415d-82b4-3808dae8178c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:50:05.243806 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.243697    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:50:05.243806 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.243736    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/1dede7b7-5895-415d-82b4-3808dae8178c-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:50:05.243806 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.243749    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8b9x8\" (UniqueName: \"kubernetes.io/projected/1dede7b7-5895-415d-82b4-3808dae8178c-kube-api-access-8b9x8\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:50:05.984063 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.984028    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"
Oct 31 07:50:05.984255 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.984037    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558" event={"ID":"1dede7b7-5895-415d-82b4-3808dae8178c","Type":"ContainerDied","Data":"edbea1a9b83609b64325603b5c548097317829f1e6b45298853e9496fb0f7fd5"}
Oct 31 07:50:05.984255 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:05.984162    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edbea1a9b83609b64325603b5c548097317829f1e6b45298853e9496fb0f7fd5"
Oct 31 07:50:10.024115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:10.024073    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"]
Oct 31 07:50:10.034923 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:10.034891    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-dac3004d-6hnjv"]
Oct 31 07:50:11.622265 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:11.622230    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9060419f-e270-4c6c-9910-6402c53fb0db" path="/var/lib/kubelet/pods/9060419f-e270-4c6c-9910-6402c53fb0db/volumes"
Oct 31 07:50:18.539062 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:18.539020    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:50:19.031022 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:19.030986    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"]
Oct 31 07:50:19.044963 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:19.044907    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-fb31e973-44vn2"]
Oct 31 07:50:19.615251 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:19.615216    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6d2ec944-1203-4c38-8f6c-fdb5c0646d56" path="/var/lib/kubelet/pods/6d2ec944-1203-4c38-8f6c-fdb5c0646d56/volumes"
Oct 31 07:50:26.897098 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:26.897060    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:50:28.697144 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:50:28.697106    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:50:30.032939 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:30.032888    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:50:33.525390 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.525350    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"]
Oct 31 07:50:33.525843 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.525828    5039 cpu_manager.go:414] "containerMap: removing container" podUID="1dede7b7-5895-415d-82b4-3808dae8178c" containerName="revoke-keys"
Oct 31 07:50:33.525887 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.525845    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1dede7b7-5895-415d-82b4-3808dae8178c" containerName="revoke-keys"
Oct 31 07:50:33.525936 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.525905    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="1dede7b7-5895-415d-82b4-3808dae8178c" containerName="revoke-keys"
Oct 31 07:50:33.529164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.529147    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.544718 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.544698    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:50:33.554725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.554693    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-2jfwt\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.554845 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.554786    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-2jfwt\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.554899 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.554871    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lqxv\" (UniqueName: \"kubernetes.io/projected/d740687e-041f-4afb-a74e-5ec9a97988fb-kube-api-access-8lqxv\") pod \"maas-api-revoke-sub-a4aef7d7-2jfwt\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.556176 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.556146    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:50:33.559356 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.559334    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"]
Oct 31 07:50:33.656185 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.656136    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-2jfwt\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.656397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.656194    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-2jfwt\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.656397 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.656234    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lqxv\" (UniqueName: \"kubernetes.io/projected/d740687e-041f-4afb-a74e-5ec9a97988fb-kube-api-access-8lqxv\") pod \"maas-api-revoke-sub-a4aef7d7-2jfwt\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.656874 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.656846    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-a4aef7d7-2jfwt\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.658672 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.658649    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-xks-ca\") pod \"maas-api-revoke-sub-a4aef7d7-2jfwt\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.674977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.674948    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lqxv\" (UniqueName: \"kubernetes.io/projected/d740687e-041f-4afb-a74e-5ec9a97988fb-kube-api-access-8lqxv\") pod \"maas-api-revoke-sub-a4aef7d7-2jfwt\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:33.842514 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:33.842429    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:34.138789 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:34.138698    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"]
Oct 31 07:50:34.141944 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:50:34.141900    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd740687e_041f_4afb_a74e_5ec9a97988fb.slice/crio-976e10e8cee90c448cf8b42682fd0dd76037d22a2d7d6c91983916d256940698 WatchSource:0}: Error finding container 976e10e8cee90c448cf8b42682fd0dd76037d22a2d7d6c91983916d256940698: Status 404 returned error can't find the container with id 976e10e8cee90c448cf8b42682fd0dd76037d22a2d7d6c91983916d256940698
Oct 31 07:50:34.174302 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:34.174269    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt" event={"ID":"d740687e-041f-4afb-a74e-5ec9a97988fb","Type":"ContainerStarted","Data":"976e10e8cee90c448cf8b42682fd0dd76037d22a2d7d6c91983916d256940698"}
Oct 31 07:50:35.182057 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:35.181967    5039 generic.go:356] "Generic (PLEG): container finished" podID="d740687e-041f-4afb-a74e-5ec9a97988fb" containerID="3cc5f6327048ea3efc8d4e7f576906908ee04473f297584981ae57ac5aec97e3" exitCode=0
Oct 31 07:50:35.182420 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:35.182059    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt" event={"ID":"d740687e-041f-4afb-a74e-5ec9a97988fb","Type":"ContainerDied","Data":"3cc5f6327048ea3efc8d4e7f576906908ee04473f297584981ae57ac5aec97e3"}
Oct 31 07:50:36.329363 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.329334    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:36.378063 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.378030    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-openshift-ca\") pod \"d740687e-041f-4afb-a74e-5ec9a97988fb\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") "
Oct 31 07:50:36.378063 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.378071    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d740687e-041f-4afb-a74e-5ec9a97988fb-kube-api-access-8lqxv\" (UniqueName: \"kubernetes.io/projected/d740687e-041f-4afb-a74e-5ec9a97988fb-kube-api-access-8lqxv\") pod \"d740687e-041f-4afb-a74e-5ec9a97988fb\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") "
Oct 31 07:50:36.378315 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.378099    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-xks-ca\") pod \"d740687e-041f-4afb-a74e-5ec9a97988fb\" (UID: \"d740687e-041f-4afb-a74e-5ec9a97988fb\") "
Oct 31 07:50:36.378518 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.378490    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-openshift-ca" pod "d740687e-041f-4afb-a74e-5ec9a97988fb" (UID: "d740687e-041f-4afb-a74e-5ec9a97988fb"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:50:36.380293 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.380264    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-xks-ca" pod "d740687e-041f-4afb-a74e-5ec9a97988fb" (UID: "d740687e-041f-4afb-a74e-5ec9a97988fb"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:50:36.380407 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.380341    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d740687e-041f-4afb-a74e-5ec9a97988fb-kube-api-access-8lqxv" pod "d740687e-041f-4afb-a74e-5ec9a97988fb" (UID: "d740687e-041f-4afb-a74e-5ec9a97988fb"). InnerVolumeSpecName "kube-api-access-8lqxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:50:36.479026 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.478987    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:50:36.479026 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.479021    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lqxv\" (UniqueName: \"kubernetes.io/projected/d740687e-041f-4afb-a74e-5ec9a97988fb-kube-api-access-8lqxv\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:50:36.479026 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:36.479034    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d740687e-041f-4afb-a74e-5ec9a97988fb-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:50:37.195717 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:37.195689    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"
Oct 31 07:50:37.195901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:37.195688    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt" event={"ID":"d740687e-041f-4afb-a74e-5ec9a97988fb","Type":"ContainerDied","Data":"976e10e8cee90c448cf8b42682fd0dd76037d22a2d7d6c91983916d256940698"}
Oct 31 07:50:37.195901 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:37.195826    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="976e10e8cee90c448cf8b42682fd0dd76037d22a2d7d6c91983916d256940698"
Oct 31 07:50:37.316374 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:37.316332    5039 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log" limit=1024
Oct 31 07:50:43.026051 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:43.026012    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"]
Oct 31 07:50:43.037154 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:43.037118    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a131f47a-mltx2"]
Oct 31 07:50:43.614910 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:43.614871    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b52efd47-605f-4417-bb71-9b59bcfb9cd9" path="/var/lib/kubelet/pods/b52efd47-605f-4417-bb71-9b59bcfb9cd9/volumes"
Oct 31 07:50:44.025542 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:44.025505    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"]
Oct 31 07:50:44.036725 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:44.036684    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f48b9cf3-z9vq4"]
Oct 31 07:50:45.614202 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:45.614166    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="db390f27-f119-44ef-8baf-33dc7a1e6a3d" path="/var/lib/kubelet/pods/db390f27-f119-44ef-8baf-33dc7a1e6a3d/volumes"
Oct 31 07:50:51.924114 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:51.924056    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rlbjc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:50:51.924925 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:51.924583    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:50:53.623084 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.623046    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"]
Oct 31 07:50:53.623506 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.623492    5039 cpu_manager.go:414] "containerMap: removing container" podUID="d740687e-041f-4afb-a74e-5ec9a97988fb" containerName="revoke-keys"
Oct 31 07:50:53.623553 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.623506    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d740687e-041f-4afb-a74e-5ec9a97988fb" containerName="revoke-keys"
Oct 31 07:50:53.623589 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.623580    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="d740687e-041f-4afb-a74e-5ec9a97988fb" containerName="revoke-keys"
Oct 31 07:50:53.626664 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.626646    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.649409 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.649373    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-gh6jn\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.649596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.649514    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2b7l\" (UniqueName: \"kubernetes.io/projected/a87647c4-30c8-4133-91fd-e90410e5a76f-kube-api-access-x2b7l\") pod \"maas-api-revoke-sub-79805ca9-gh6jn\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.649666 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.649596    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-gh6jn\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.652962 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.652901    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 07:50:53.653169 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.653146    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-phfw6\""
Oct 31 07:50:53.656870 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.656842    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"]
Oct 31 07:50:53.750570 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.750527    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2b7l\" (UniqueName: \"kubernetes.io/projected/a87647c4-30c8-4133-91fd-e90410e5a76f-kube-api-access-x2b7l\") pod \"maas-api-revoke-sub-79805ca9-gh6jn\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.750765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.750603    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-gh6jn\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.750765 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.750636    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-gh6jn\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.751408 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.751383    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-79805ca9-gh6jn\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.753065 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.753042    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-79805ca9-gh6jn\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.769352 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.769324    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2b7l\" (UniqueName: \"kubernetes.io/projected/a87647c4-30c8-4133-91fd-e90410e5a76f-kube-api-access-x2b7l\") pod \"maas-api-revoke-sub-79805ca9-gh6jn\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:53.940138 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:53.940050    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:54.245012 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:54.244979    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"]
Oct 31 07:50:54.248586 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:50:54.248551    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda87647c4_30c8_4133_91fd_e90410e5a76f.slice/crio-605c0d457267863bdeeb6a1e656b0178f6363b2f6d94e4f5acda547bb7176d15 WatchSource:0}: Error finding container 605c0d457267863bdeeb6a1e656b0178f6363b2f6d94e4f5acda547bb7176d15: Status 404 returned error can't find the container with id 605c0d457267863bdeeb6a1e656b0178f6363b2f6d94e4f5acda547bb7176d15
Oct 31 07:50:54.332472 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:54.332433    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn" event={"ID":"a87647c4-30c8-4133-91fd-e90410e5a76f","Type":"ContainerStarted","Data":"605c0d457267863bdeeb6a1e656b0178f6363b2f6d94e4f5acda547bb7176d15"}
Oct 31 07:50:55.032853 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:55.032816    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"]
Oct 31 07:50:55.044596 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:55.044570    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-31de0bd4-jnnnm"]
Oct 31 07:50:55.340017 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:55.339909    5039 generic.go:356] "Generic (PLEG): container finished" podID="a87647c4-30c8-4133-91fd-e90410e5a76f" containerID="6df5d4d0df8b825e5be5e0996702790c16da00812f1cff682437262b56129cb0" exitCode=0
Oct 31 07:50:55.340156 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:55.340023    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn" event={"ID":"a87647c4-30c8-4133-91fd-e90410e5a76f","Type":"ContainerDied","Data":"6df5d4d0df8b825e5be5e0996702790c16da00812f1cff682437262b56129cb0"}
Oct 31 07:50:55.614861 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:55.614781    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2883f0c3-7a45-4613-93dd-fa8a18d89e91" path="/var/lib/kubelet/pods/2883f0c3-7a45-4613-93dd-fa8a18d89e91/volumes"
Oct 31 07:50:56.487990 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.487950    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:56.578924 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.578869    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-xks-ca\") pod \"a87647c4-30c8-4133-91fd-e90410e5a76f\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") "
Oct 31 07:50:56.579113 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.579012    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-openshift-ca\") pod \"a87647c4-30c8-4133-91fd-e90410e5a76f\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") "
Oct 31 07:50:56.579113 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.579054    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a87647c4-30c8-4133-91fd-e90410e5a76f-kube-api-access-x2b7l\" (UniqueName: \"kubernetes.io/projected/a87647c4-30c8-4133-91fd-e90410e5a76f-kube-api-access-x2b7l\") pod \"a87647c4-30c8-4133-91fd-e90410e5a76f\" (UID: \"a87647c4-30c8-4133-91fd-e90410e5a76f\") "
Oct 31 07:50:56.579401 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.579366    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-openshift-ca" pod "a87647c4-30c8-4133-91fd-e90410e5a76f" (UID: "a87647c4-30c8-4133-91fd-e90410e5a76f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 07:50:56.581048 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.581019    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-xks-ca" pod "a87647c4-30c8-4133-91fd-e90410e5a76f" (UID: "a87647c4-30c8-4133-91fd-e90410e5a76f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:50:56.581158 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.581122    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a87647c4-30c8-4133-91fd-e90410e5a76f-kube-api-access-x2b7l" pod "a87647c4-30c8-4133-91fd-e90410e5a76f" (UID: "a87647c4-30c8-4133-91fd-e90410e5a76f"). InnerVolumeSpecName "kube-api-access-x2b7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:50:56.680426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.680339    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2b7l\" (UniqueName: \"kubernetes.io/projected/a87647c4-30c8-4133-91fd-e90410e5a76f-kube-api-access-x2b7l\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:50:56.680426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.680370    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-xks-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:50:56.680426 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:56.680382    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/a87647c4-30c8-4133-91fd-e90410e5a76f-maas-api-openshift-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:50:57.352747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:57.352709    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn" event={"ID":"a87647c4-30c8-4133-91fd-e90410e5a76f","Type":"ContainerDied","Data":"605c0d457267863bdeeb6a1e656b0178f6363b2f6d94e4f5acda547bb7176d15"}
Oct 31 07:50:57.352747 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:57.352745    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"
Oct 31 07:50:57.352990 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:50:57.352761    5039 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="605c0d457267863bdeeb6a1e656b0178f6363b2f6d94e4f5acda547bb7176d15"
Oct 31 07:50:58.695789 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:50:58.695745    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:51:06.186136 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:51:06.186103    5039 scope.go:122] "RemoveContainer" containerID="640d64b0fe4950ce98d377a2bcec69af38f1fe22db6016cfb20d5c27a0c34cd0"
Oct 31 07:51:18.023897 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:51:18.023818    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"]
Oct 31 07:51:18.035110 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:51:18.035079    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-091c1d6e-cb4bs"]
Oct 31 07:51:19.615010 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:51:19.614975    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f8491677-90c0-4878-ae1e-d7f8e86f1cc1" path="/var/lib/kubelet/pods/f8491677-90c0-4878-ae1e-d7f8e86f1cc1/volumes"
Oct 31 07:51:28.696386 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:51:28.696343    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:51:38.129443 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:51:38.129386    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 07:51:38.130092 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:51:38.129487    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 07:51:58.696591 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:51:58.696548    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:52:06.212453 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:52:06.212410    5039 scope.go:122] "RemoveContainer" containerID="748fe34f351c1c5190adf83ef3aaa4a6c213970fcbcd0bbab02d40b0cfa06061"
Oct 31 07:52:06.222239 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:52:06.222209    5039 scope.go:122] "RemoveContainer" containerID="92fa690219ae3ea7cf5485b1fa1fe9a15e5dc0aca62b062c4c0ae854c6aa54dc"
Oct 31 07:52:06.230790 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:52:06.230769    5039 scope.go:122] "RemoveContainer" containerID="e1011f885a2bc3f0cfcfd44c9b31d276cc3ef8512478a1a5a3c97cfe5df569dd"
Oct 31 07:52:06.239489 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:52:06.239469    5039 scope.go:122] "RemoveContainer" containerID="9abd809bcf2b9e5d103600167f4633eb38f332f9b95a8eb17b601b4800e55cf0"
Oct 31 07:52:06.247968 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:52:06.247943    5039 scope.go:122] "RemoveContainer" containerID="45806b4ff901ac6122cf85d330356f217530653285e9771f5570fcc32091de99"
Oct 31 07:52:06.256296 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:52:06.256277    5039 scope.go:122] "RemoveContainer" containerID="108abb83e9a4638929b9bf6a60c824f42f85631cbd8b70c1fbf64fedb727a21f"
Oct 31 07:52:08.026019 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:52:08.025983    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"]
Oct 31 07:52:08.037030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:52:08.036987    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-85237e45-klg8z"]
Oct 31 07:52:09.614840 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:52:09.614805    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8178a25-0f89-4463-93fa-bbaf5998e5ab" path="/var/lib/kubelet/pods/c8178a25-0f89-4463-93fa-bbaf5998e5ab/volumes"
Oct 31 07:52:28.696196 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:52:28.696151    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:52:58.695734 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:52:58.695649    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:53:05.875099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:05.875069    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:53:05.880678 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:05.880652    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:53:05.886887 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:05.886861    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:53:05.892355 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:05.892334    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:53:06.304314 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:06.304281    5039 scope.go:122] "RemoveContainer" containerID="df8836b9de86cee4b11910e4a12ba2bab23d32c180fb0495703c9e64b902243e"
Oct 31 07:53:06.313384 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:06.313363    5039 scope.go:122] "RemoveContainer" containerID="acff9323eaa20ee50f0b54ce65b010e279d6cf055e1ffa49ccf40c44901d16f1"
Oct 31 07:53:15.023060 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:15.023021    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"]
Oct 31 07:53:15.034255 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:15.034224    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-c1e271a9-6fnpr"]
Oct 31 07:53:15.615278 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:15.615243    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3840a3c9-161e-44bf-920a-1646b17c2d77" path="/var/lib/kubelet/pods/3840a3c9-161e-44bf-920a-1646b17c2d77/volumes"
Oct 31 07:53:28.696292 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:53:28.696248    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:53:35.024379 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:35.024339    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"]
Oct 31 07:53:35.035893 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:35.035853    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2e1f5b5f-vxzlr"]
Oct 31 07:53:35.621767 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:35.621721    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9ea4e346-f0c3-4436-a959-dadb7cc793b7" path="/var/lib/kubelet/pods/9ea4e346-f0c3-4436-a959-dadb7cc793b7/volumes"
Oct 31 07:53:46.024639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:46.024593    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"]
Oct 31 07:53:46.035888 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:46.035858    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ec843018-szqzd"]
Oct 31 07:53:47.614645 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:53:47.614608    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a88d254-466e-4d45-b0d4-dd5ed66a76f1" path="/var/lib/kubelet/pods/1a88d254-466e-4d45-b0d4-dd5ed66a76f1/volumes"
Oct 31 07:53:58.695925 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:53:58.695874    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:54:16.064652 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.064561    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"]
Oct 31 07:54:16.065267 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.065203    5039 cpu_manager.go:414] "containerMap: removing container" podUID="a87647c4-30c8-4133-91fd-e90410e5a76f" containerName="revoke-keys"
Oct 31 07:54:16.065267 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.065225    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a87647c4-30c8-4133-91fd-e90410e5a76f" containerName="revoke-keys"
Oct 31 07:54:16.065389 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.065379    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="a87647c4-30c8-4133-91fd-e90410e5a76f" containerName="revoke-keys"
Oct 31 07:54:16.068875 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.068852    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.083521 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.083490    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-009b0f\"/\"openshift-service-ca.crt\""
Oct 31 07:54:16.094770 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.094735    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-009b0f\"/\"simulator-single-main-009b0f-kserve-self-signed-certs\""
Oct 31 07:54:16.094770 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.094766    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-009b0f\"/\"kube-root-ca.crt\""
Oct 31 07:54:16.095015 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.094886    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-009b0f\"/\"default-dockercfg-g9cdq\""
Oct 31 07:54:16.097650 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.097623    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"]
Oct 31 07:54:16.186287 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.186252    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tls-certs\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.186461 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.186296    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-model-cache\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.186461 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.186328    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tmp-dir\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.186461 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.186454    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh8s9\" (UniqueName: \"kubernetes.io/projected/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-kube-api-access-vh8s9\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.186583 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.186490    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-dshm\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.186654 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.186629    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-home\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.287849 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.287807    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tmp-dir\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.288041 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.287889    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh8s9\" (UniqueName: \"kubernetes.io/projected/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-kube-api-access-vh8s9\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.288041 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.287964    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-dshm\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.288041 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.288029    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-home\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.288184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.288092    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tls-certs\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.288184 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.288130    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-model-cache\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.288311 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.288229    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tmp-dir\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.288427 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.288407    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-home\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.288504 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.288425    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-model-cache\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.290293 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.290270    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-dshm\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.290537 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.290518    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tls-certs\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.305942 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.305906    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh8s9\" (UniqueName: \"kubernetes.io/projected/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-kube-api-access-vh8s9\") pod \"simulator-single-main-009b0f-kserve-5c66764759-lmb6z\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") " pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.382703 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.382611    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:16.680157 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:16.680075    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"]
Oct 31 07:54:16.683801 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:54:16.683774    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod46b2e528_d0b6_4aa4_aa12_a3399dc2df20.slice/crio-b38bfd1be49eca413fbc2068c1ecf2a7eb619737a205e6b5b4dd4def098cf99d WatchSource:0}: Error finding container b38bfd1be49eca413fbc2068c1ecf2a7eb619737a205e6b5b4dd4def098cf99d: Status 404 returned error can't find the container with id b38bfd1be49eca413fbc2068c1ecf2a7eb619737a205e6b5b4dd4def098cf99d
Oct 31 07:54:17.689367 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:17.689327    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z" event={"ID":"46b2e528-d0b6-4aa4-aa12-a3399dc2df20","Type":"ContainerStarted","Data":"18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f"}
Oct 31 07:54:17.689762 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:17.689379    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z" event={"ID":"46b2e528-d0b6-4aa4-aa12-a3399dc2df20","Type":"ContainerStarted","Data":"b38bfd1be49eca413fbc2068c1ecf2a7eb619737a205e6b5b4dd4def098cf99d"}
Oct 31 07:54:17.725366 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:17.725308    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z" podStartSLOduration=1.7252915899999999 podStartE2EDuration="1.72529159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:54:17.724937197 +0000 UTC m=+1572.254131861" watchObservedRunningTime="2026-10-31 07:54:17.72529159 +0000 UTC m=+1572.254486268"
Oct 31 07:54:18.383115 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:18.383077    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:26.383030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:26.382992    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:26.395637 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:26.395599    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:26.754393 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:26.754359    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:54:28.696101 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:54:28.696058    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:54:33.024285 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:33.024249    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"]
Oct 31 07:54:33.035701 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:33.035664    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-046e1343-p49k5"]
Oct 31 07:54:33.614838 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:33.614803    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="83eade2d-cc05-4239-841d-bea52b4dd668" path="/var/lib/kubelet/pods/83eade2d-cc05-4239-841d-bea52b4dd668/volumes"
Oct 31 07:54:44.024957 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:44.024902    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"]
Oct 31 07:54:44.035865 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:44.035827    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-d3fba056-46xh5"]
Oct 31 07:54:45.614660 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:54:45.614622    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="483f5532-28d0-42bb-98bb-0f5ebc1e2169" path="/var/lib/kubelet/pods/483f5532-28d0-42bb-98bb-0f5ebc1e2169/volumes"
Oct 31 07:54:58.696366 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:54:58.696317    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:55:06.029727 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:06.029684    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"]
Oct 31 07:55:06.040666 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:06.040636    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-ae594979-m2558"]
Oct 31 07:55:06.349480 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:06.349400    5039 scope.go:122] "RemoveContainer" containerID="2b662c602254904727b4d8eb1e58d1cb2899d0cba8b4af73138cc2249458ecde"
Oct 31 07:55:06.358612 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:06.358592    5039 scope.go:122] "RemoveContainer" containerID="a6b9305bd23df2dcdf77d71e0a0d85e49a09a599da12d423ee90a0ea29a06d92"
Oct 31 07:55:06.367090 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:06.367071    5039 scope.go:122] "RemoveContainer" containerID="d5ae5f26cbbb5e4986aa42842a1afa0d7b2068d5ff4353f75c9dff30cb19ccef"
Oct 31 07:55:07.617173 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:07.617137    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1dede7b7-5895-415d-82b4-3808dae8178c" path="/var/lib/kubelet/pods/1dede7b7-5895-415d-82b4-3808dae8178c/volumes"
Oct 31 07:55:13.665424 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:13.665383    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"]
Oct 31 07:55:28.685805 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:28.685758    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z" podUID="46b2e528-d0b6-4aa4-aa12-a3399dc2df20" containerName="main" containerID="cri-o://18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f" gracePeriod=45
Oct 31 07:55:28.701091 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:55:28.701055    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:55:28.743600 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:28.743566    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z" podUID="46b2e528-d0b6-4aa4-aa12-a3399dc2df20" containerName="main" probeResult="failure" output="Get \"https://10.132.0.123:8000/ready\": dial tcp 10.132.0.123:8000: connect: connection refused"
Oct 31 07:55:28.940003 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:28.939944    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:55:29.001140 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001101    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-kube-api-access-vh8s9\" (UniqueName: \"kubernetes.io/projected/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-kube-api-access-vh8s9\") pod \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") "
Oct 31 07:55:29.001336 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001165    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tmp-dir\") pod \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") "
Oct 31 07:55:29.001336 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001231    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-model-cache\") pod \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") "
Oct 31 07:55:29.001336 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001267    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-dshm\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-dshm\") pod \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") "
Oct 31 07:55:29.001336 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001318    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-home\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-home\") pod \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") "
Oct 31 07:55:29.001566 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001366    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tls-certs\" (UniqueName: \"kubernetes.io/secret/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tls-certs\") pod \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\" (UID: \"46b2e528-d0b6-4aa4-aa12-a3399dc2df20\") "
Oct 31 07:55:29.001566 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001492    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-model-cache" pod "46b2e528-d0b6-4aa4-aa12-a3399dc2df20" (UID: "46b2e528-d0b6-4aa4-aa12-a3399dc2df20"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:55:29.001566 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001486    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tmp-dir" pod "46b2e528-d0b6-4aa4-aa12-a3399dc2df20" (UID: "46b2e528-d0b6-4aa4-aa12-a3399dc2df20"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:55:29.001695 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001635    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-home" pod "46b2e528-d0b6-4aa4-aa12-a3399dc2df20" (UID: "46b2e528-d0b6-4aa4-aa12-a3399dc2df20"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:55:29.001763 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001743    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:55:29.001821 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001767    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:55:29.001821 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.001779    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:55:29.003639 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.003615    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-dshm" pod "46b2e528-d0b6-4aa4-aa12-a3399dc2df20" (UID: "46b2e528-d0b6-4aa4-aa12-a3399dc2df20"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:55:29.003793 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.003766    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tls-certs" pod "46b2e528-d0b6-4aa4-aa12-a3399dc2df20" (UID: "46b2e528-d0b6-4aa4-aa12-a3399dc2df20"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:55:29.003896 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.003869    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-kube-api-access-vh8s9" pod "46b2e528-d0b6-4aa4-aa12-a3399dc2df20" (UID: "46b2e528-d0b6-4aa4-aa12-a3399dc2df20"). InnerVolumeSpecName "kube-api-access-vh8s9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:55:29.102694 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.102646    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh8s9\" (UniqueName: \"kubernetes.io/projected/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-kube-api-access-vh8s9\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:55:29.102694 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.102686    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:55:29.102694 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.102701    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/46b2e528-d0b6-4aa4-aa12-a3399dc2df20-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:55:29.122578 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.122539    5039 generic.go:356] "Generic (PLEG): container finished" podID="46b2e528-d0b6-4aa4-aa12-a3399dc2df20" containerID="18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f" exitCode=0
Oct 31 07:55:29.122759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.122588    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"
Oct 31 07:55:29.122759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.122620    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z" event={"ID":"46b2e528-d0b6-4aa4-aa12-a3399dc2df20","Type":"ContainerDied","Data":"18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f"}
Oct 31 07:55:29.122759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.122671    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z" event={"ID":"46b2e528-d0b6-4aa4-aa12-a3399dc2df20","Type":"ContainerDied","Data":"b38bfd1be49eca413fbc2068c1ecf2a7eb619737a205e6b5b4dd4def098cf99d"}
Oct 31 07:55:29.122759 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.122692    5039 scope.go:122] "RemoveContainer" containerID="18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f"
Oct 31 07:55:29.133036 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.133008    5039 scope.go:122] "RemoveContainer" containerID="18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f"
Oct 31 07:55:29.133323 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:55:29.133299    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f\": container with ID starting with 18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f not found: ID does not exist" containerID="18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f"
Oct 31 07:55:29.133377 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.133333    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f"} err="failed to get container status \"18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f\": rpc error: code = NotFound desc = could not find container \"18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f\": container with ID starting with 18345b46ce9f139a22ee336dfe69d17b9ef152847a181b9250b072b9ca9e787f not found: ID does not exist"
Oct 31 07:55:29.170231 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.170194    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"]
Oct 31 07:55:29.174104 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.174073    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-009b0f/simulator-single-main-009b0f-kserve-5c66764759-lmb6z"]
Oct 31 07:55:29.615530 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:29.615496    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="46b2e528-d0b6-4aa4-aa12-a3399dc2df20" path="/var/lib/kubelet/pods/46b2e528-d0b6-4aa4-aa12-a3399dc2df20/volumes"
Oct 31 07:55:37.029312 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:37.029261    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"]
Oct 31 07:55:37.036977 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:37.036939    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-a4aef7d7-2jfwt"]
Oct 31 07:55:37.614419 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:37.614381    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d740687e-041f-4afb-a74e-5ec9a97988fb" path="/var/lib/kubelet/pods/d740687e-041f-4afb-a74e-5ec9a97988fb/volumes"
Oct 31 07:55:57.036592 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:57.036500    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"]
Oct 31 07:55:57.047435 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:57.047403    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-79805ca9-gh6jn"]
Oct 31 07:55:57.615199 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:55:57.615160    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a87647c4-30c8-4133-91fd-e90410e5a76f" path="/var/lib/kubelet/pods/a87647c4-30c8-4133-91fd-e90410e5a76f/volumes"
Oct 31 07:55:58.696111 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:55:58.696070    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:56:06.399757 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:56:06.399720    5039 scope.go:122] "RemoveContainer" containerID="676e9abfaddcba1da5be7132382ec5efd067ff6d3d6f01dcabd3c67ef9d08bbe"
Oct 31 07:56:06.411247 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:56:06.411219    5039 scope.go:122] "RemoveContainer" containerID="e243fc5944a6694af393d36ab82663a4048d82efced4c7551c86a1c03e0aced7"
Oct 31 07:56:06.419868 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:56:06.419845    5039 scope.go:122] "RemoveContainer" containerID="69634f29422f8d08ba948d86acad6726fbfa8bc1618f0d5bf4a91d5ea39c6143"
Oct 31 07:56:28.696053 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:56:28.696015    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:56:58.696278 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:56:58.696240    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:57:06.455513 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:57:06.455480    5039 scope.go:122] "RemoveContainer" containerID="3cc5f6327048ea3efc8d4e7f576906908ee04473f297584981ae57ac5aec97e3"
Oct 31 07:57:06.464891 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:57:06.464863    5039 scope.go:122] "RemoveContainer" containerID="6df5d4d0df8b825e5be5e0996702790c16da00812f1cff682437262b56129cb0"
Oct 31 07:57:28.695988 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:57:28.695946    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:57:41.384881 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:57:41.384827    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal" podUID="e7ef466d4952ee7684f323b6e3eda034" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": context deadline exceeded"
Oct 31 07:57:58.696979 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:57:58.696938    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:58:05.917530 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:05.917494    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:58:05.921073 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:05.921043    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 07:58:05.929109 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:05.929078    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:58:05.931943 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:05.931909    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 07:58:28.695097 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:58:28.695061    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:58:52.094403 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.094191    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"]
Oct 31 07:58:52.095099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.094865    5039 cpu_manager.go:414] "containerMap: removing container" podUID="46b2e528-d0b6-4aa4-aa12-a3399dc2df20" containerName="main"
Oct 31 07:58:52.095099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.094887    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="46b2e528-d0b6-4aa4-aa12-a3399dc2df20" containerName="main"
Oct 31 07:58:52.095099 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.095036    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="46b2e528-d0b6-4aa4-aa12-a3399dc2df20" containerName="main"
Oct 31 07:58:52.098690 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.098665    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.127895 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.127716    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-11a81e\"/\"openshift-service-ca.crt\""
Oct 31 07:58:52.127895 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.127743    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-11a81e\"/\"default-dockercfg-wn944\""
Oct 31 07:58:52.127895 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.127717    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-single-main-11a81e\"/\"kube-root-ca.crt\""
Oct 31 07:58:52.127895 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.127844    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-single-main-11a81e\"/\"simulator-single-main-11a81e-kserve-self-signed-certs\""
Oct 31 07:58:52.130374 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.130347    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"]
Oct 31 07:58:52.147203 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.147166    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhhps\" (UniqueName: \"kubernetes.io/projected/f4c7e75e-d63c-4ea5-a430-1453b66c088b-kube-api-access-jhhps\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.147421 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.147226    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tls-certs\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.147421 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.147337    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-model-cache\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.147421 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.147410    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-dshm\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.147595 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.147443    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-home\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.147595 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.147505    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tmp-dir\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.248617 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.248572    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhhps\" (UniqueName: \"kubernetes.io/projected/f4c7e75e-d63c-4ea5-a430-1453b66c088b-kube-api-access-jhhps\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.248818 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.248653    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tls-certs\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.248818 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.248691    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-model-cache\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.248818 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.248725    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-dshm\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.249040 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.249010    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-home\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.249108 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.249080    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tmp-dir\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.249337 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.249311    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-model-cache\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.249517 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.249488    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tmp-dir\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.249659 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.249359    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-home\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.251280 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.251254    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-dshm\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.251628 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.251606    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tls-certs\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.266857 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.266816    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhhps\" (UniqueName: \"kubernetes.io/projected/f4c7e75e-d63c-4ea5-a430-1453b66c088b-kube-api-access-jhhps\") pod \"simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") " pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.412555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.412465    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:52.712164 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:52.712129    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"]
Oct 31 07:58:52.716370 ip-10-0-128-20 kubenswrapper[5039]: W1031 07:58:52.716340    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf4c7e75e_d63c_4ea5_a430_1453b66c088b.slice/crio-cba5b2b04ecf1cab4ec5c86c1af3e3a852e0927fd3182c0e8773b2f4712a2402 WatchSource:0}: Error finding container cba5b2b04ecf1cab4ec5c86c1af3e3a852e0927fd3182c0e8773b2f4712a2402: Status 404 returned error can't find the container with id cba5b2b04ecf1cab4ec5c86c1af3e3a852e0927fd3182c0e8773b2f4712a2402
Oct 31 07:58:53.352609 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:53.352556    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf" event={"ID":"f4c7e75e-d63c-4ea5-a430-1453b66c088b","Type":"ContainerStarted","Data":"1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812"}
Oct 31 07:58:53.352609 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:53.352612    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf" event={"ID":"f4c7e75e-d63c-4ea5-a430-1453b66c088b","Type":"ContainerStarted","Data":"cba5b2b04ecf1cab4ec5c86c1af3e3a852e0927fd3182c0e8773b2f4712a2402"}
Oct 31 07:58:53.389615 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:53.389559    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf" podStartSLOduration=1.3895440749999999 podStartE2EDuration="1.389544075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 07:58:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 07:58:53.388200475 +0000 UTC m=+1847.917395149" watchObservedRunningTime="2026-10-31 07:58:53.389544075 +0000 UTC m=+1847.918738748"
Oct 31 07:58:53.413353 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:58:53.413319    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:58:58.694447 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:58:58.694407    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:59:02.412910 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:02.412872    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:59:02.425605 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:02.425571    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:59:03.421108 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:03.421077    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:59:28.699735 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:59:28.699692    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 07:59:36.934663 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:36.934627    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"]
Oct 31 07:59:51.955206 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:51.955140    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf" podUID="f4c7e75e-d63c-4ea5-a430-1453b66c088b" containerName="main" containerID="cri-o://1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812" gracePeriod=45
Oct 31 07:59:52.204555 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.204524    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:59:52.264857 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.264768    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-dshm\") pod \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") "
Oct 31 07:59:52.265054 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.264883    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-home\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-home\") pod \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") "
Oct 31 07:59:52.265054 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.264931    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f4c7e75e-d63c-4ea5-a430-1453b66c088b-kube-api-access-jhhps\" (UniqueName: \"kubernetes.io/projected/f4c7e75e-d63c-4ea5-a430-1453b66c088b-kube-api-access-jhhps\") pod \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") "
Oct 31 07:59:52.265054 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.264967    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-model-cache\") pod \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") "
Oct 31 07:59:52.265054 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.265023    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tls-certs\") pod \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") "
Oct 31 07:59:52.265312 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.265085    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tmp-dir\") pod \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\" (UID: \"f4c7e75e-d63c-4ea5-a430-1453b66c088b\") "
Oct 31 07:59:52.265372 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.265306    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-model-cache" pod "f4c7e75e-d63c-4ea5-a430-1453b66c088b" (UID: "f4c7e75e-d63c-4ea5-a430-1453b66c088b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:59:52.265543 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.265520    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:59:52.265624 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.265557    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tmp-dir" pod "f4c7e75e-d63c-4ea5-a430-1453b66c088b" (UID: "f4c7e75e-d63c-4ea5-a430-1453b66c088b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:59:52.265683 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.265640    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-home" pod "f4c7e75e-d63c-4ea5-a430-1453b66c088b" (UID: "f4c7e75e-d63c-4ea5-a430-1453b66c088b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:59:52.267365 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.267334    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-dshm" pod "f4c7e75e-d63c-4ea5-a430-1453b66c088b" (UID: "f4c7e75e-d63c-4ea5-a430-1453b66c088b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 07:59:52.267496 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.267408    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4c7e75e-d63c-4ea5-a430-1453b66c088b-kube-api-access-jhhps" pod "f4c7e75e-d63c-4ea5-a430-1453b66c088b" (UID: "f4c7e75e-d63c-4ea5-a430-1453b66c088b"). InnerVolumeSpecName "kube-api-access-jhhps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 07:59:52.267831 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.267800    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tls-certs" pod "f4c7e75e-d63c-4ea5-a430-1453b66c088b" (UID: "f4c7e75e-d63c-4ea5-a430-1453b66c088b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 07:59:52.367030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.366982    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhhps\" (UniqueName: \"kubernetes.io/projected/f4c7e75e-d63c-4ea5-a430-1453b66c088b-kube-api-access-jhhps\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:59:52.367030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.367022    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:59:52.367030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.367032    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:59:52.367030 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.367040    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:59:52.367303 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.367048    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f4c7e75e-d63c-4ea5-a430-1453b66c088b-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 07:59:52.692450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.692359    5039 generic.go:356] "Generic (PLEG): container finished" podID="f4c7e75e-d63c-4ea5-a430-1453b66c088b" containerID="1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812" exitCode=0
Oct 31 07:59:52.692450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.692410    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"
Oct 31 07:59:52.692450 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.692425    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf" event={"ID":"f4c7e75e-d63c-4ea5-a430-1453b66c088b","Type":"ContainerDied","Data":"1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812"}
Oct 31 07:59:52.692718 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.692466    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf" event={"ID":"f4c7e75e-d63c-4ea5-a430-1453b66c088b","Type":"ContainerDied","Data":"cba5b2b04ecf1cab4ec5c86c1af3e3a852e0927fd3182c0e8773b2f4712a2402"}
Oct 31 07:59:52.692718 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.692487    5039 scope.go:122] "RemoveContainer" containerID="1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812"
Oct 31 07:59:52.702111 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.702088    5039 scope.go:122] "RemoveContainer" containerID="1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812"
Oct 31 07:59:52.702405 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:59:52.702384    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812\": container with ID starting with 1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812 not found: ID does not exist" containerID="1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812"
Oct 31 07:59:52.702471 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.702419    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812"} err="failed to get container status \"1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812\": rpc error: code = NotFound desc = could not find container \"1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812\": container with ID starting with 1c4c3807fb77a8e49c11b09fe743ae9967ce3e99b8a9082e298b4ab636dc4812 not found: ID does not exist"
Oct 31 07:59:52.740618 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.740581    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"]
Oct 31 07:59:52.751627 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:52.751596    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-single-main-11a81e/simulator-single-main-11a81e-kserve-76b5bb7b6c-l4twf"]
Oct 31 07:59:53.616135 ip-10-0-128-20 kubenswrapper[5039]: I1031 07:59:53.616099    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f4c7e75e-d63c-4ea5-a430-1453b66c088b" path="/var/lib/kubelet/pods/f4c7e75e-d63c-4ea5-a430-1453b66c088b/volumes"
Oct 31 07:59:58.696116 ip-10-0-128-20 kubenswrapper[5039]: E1031 07:59:58.696080    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:00:22.330884 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.330780    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"]
Oct 31 08:00:22.331458 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.331436    5039 cpu_manager.go:414] "containerMap: removing container" podUID="f4c7e75e-d63c-4ea5-a430-1453b66c088b" containerName="main"
Oct 31 08:00:22.331546 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.331461    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f4c7e75e-d63c-4ea5-a430-1453b66c088b" containerName="main"
Oct 31 08:00:22.331615 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.331599    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="f4c7e75e-d63c-4ea5-a430-1453b66c088b" containerName="main"
Oct 31 08:00:22.339318 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.339276    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.355333 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.354300    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"]
Oct 31 08:00:22.362031 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.361998    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 31 08:00:22.362031 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.362042    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-4a5b1e12-kserve-self-signed-certs\""
Oct 31 08:00:22.367083 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.367058    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 31 08:00:22.367186 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.367100    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mghfb\""
Oct 31 08:00:22.474377 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.474339    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9bkm\" (UniqueName: \"kubernetes.io/projected/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-kube-api-access-x9bkm\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.474377 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.474382    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-model-cache\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.474685 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.474522    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tmp-dir\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.474685 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.474547    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-dshm\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.474685 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.474623    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-home\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.474819 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.474725    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tls-certs\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.575684 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.575644    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tmp-dir\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.575684 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.575693    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-dshm\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.575941 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.575798    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-home\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.575941 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.575852    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tls-certs\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.576037 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.575996    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9bkm\" (UniqueName: \"kubernetes.io/projected/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-kube-api-access-x9bkm\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.576085 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.576034    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-model-cache\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.576163 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.576130    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tmp-dir\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.576443 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.576413    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-model-cache\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.576443 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.576428    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-home\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.578099 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.578075    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-dshm\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.578389 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.578373    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tls-certs\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.593944 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.593855    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9bkm\" (UniqueName: \"kubernetes.io/projected/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-kube-api-access-x9bkm\") pod \"e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") " pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.660305 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.660269    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:22.959006 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:22.958973    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"]
Oct 31 08:00:22.962794 ip-10-0-128-20 kubenswrapper[5039]: W1031 08:00:22.962758    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb0a0c0a_5d1a_4837_b33b_a1f669f2f3fb.slice/crio-34c2348cb225b42aae475d2d52d992e4d29a1721866f1e4efa711b870151eb0d WatchSource:0}: Error finding container 34c2348cb225b42aae475d2d52d992e4d29a1721866f1e4efa711b870151eb0d: Status 404 returned error can't find the container with id 34c2348cb225b42aae475d2d52d992e4d29a1721866f1e4efa711b870151eb0d
Oct 31 08:00:23.870414 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:23.870371    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5" event={"ID":"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb","Type":"ContainerStarted","Data":"e1e333374c1f7d171fbc5dd64e54a2adf039499b7e9347720a8d739a8477a181"}
Oct 31 08:00:23.870875 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:23.870426    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5" event={"ID":"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb","Type":"ContainerStarted","Data":"34c2348cb225b42aae475d2d52d992e4d29a1721866f1e4efa711b870151eb0d"}
Oct 31 08:00:23.908960 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:23.908892    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5" podStartSLOduration=1.908877925 podStartE2EDuration="1.908877925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:00:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:00:23.907467703 +0000 UTC m=+1938.436662377" watchObservedRunningTime="2026-10-31 08:00:23.908877925 +0000 UTC m=+1938.438072599"
Oct 31 08:00:24.660608 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:24.660566    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:28.696113 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:00:28.696068    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:00:32.661338 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:32.661302    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:32.675003 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:32.674971    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:32.965493 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:32.965462    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:00:37.672474 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.672430    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"]
Oct 31 08:00:37.676379 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.676351    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.696497 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.696464    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"]
Oct 31 08:00:37.704825 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.704798    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-4a5b1e12-kserve-self-signed-certs\""
Oct 31 08:00:37.735106 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.735070    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2109310b-91e0-444f-981b-24a4708928d7-tls-certs\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.735307 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.735136    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-dshm\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.735307 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.735290    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-model-cache\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.735445 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.735307    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-tmp-dir\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.735508 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.735437    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v52dp\" (UniqueName: \"kubernetes.io/projected/2109310b-91e0-444f-981b-24a4708928d7-kube-api-access-v52dp\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.735508 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.735489    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-home\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.837186 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.837139    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-model-cache\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.837186 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.837186    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-tmp-dir\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.837469 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.837242    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v52dp\" (UniqueName: \"kubernetes.io/projected/2109310b-91e0-444f-981b-24a4708928d7-kube-api-access-v52dp\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.837469 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.837287    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-home\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.837469 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.837368    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2109310b-91e0-444f-981b-24a4708928d7-tls-certs\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.837469 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.837401    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-dshm\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.837672 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.837647    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-model-cache\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.837712 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.837690    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-tmp-dir\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.837976 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.837950    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-home\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.839900 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.839873    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-dshm\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.840060 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.840001    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2109310b-91e0-444f-981b-24a4708928d7-tls-certs\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.855356 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.855325    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v52dp\" (UniqueName: \"kubernetes.io/projected/2109310b-91e0-444f-981b-24a4708928d7-kube-api-access-v52dp\") pod \"e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") " pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:37.990634 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:37.990589    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:38.290738 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:38.290615    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"]
Oct 31 08:00:38.294712 ip-10-0-128-20 kubenswrapper[5039]: W1031 08:00:38.294677    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2109310b_91e0_444f_981b_24a4708928d7.slice/crio-d1d47dc2c43c7fef60b9c1d09f1f573f578248b7fc4af48594282806a4ff70c9 WatchSource:0}: Error finding container d1d47dc2c43c7fef60b9c1d09f1f573f578248b7fc4af48594282806a4ff70c9: Status 404 returned error can't find the container with id d1d47dc2c43c7fef60b9c1d09f1f573f578248b7fc4af48594282806a4ff70c9
Oct 31 08:00:38.990062 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:38.990015    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl" event={"ID":"2109310b-91e0-444f-981b-24a4708928d7","Type":"ContainerStarted","Data":"1b90f632c18e7b4ebbdb5ad063c08b27fb517b9d97df03f79ebfa7ba7abcfdec"}
Oct 31 08:00:38.990476 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:38.990071    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl" event={"ID":"2109310b-91e0-444f-981b-24a4708928d7","Type":"ContainerStarted","Data":"d1d47dc2c43c7fef60b9c1d09f1f573f578248b7fc4af48594282806a4ff70c9"}
Oct 31 08:00:38.991252 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:38.991234    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:39.027036 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:39.026948    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl" podStartSLOduration=2.026932042 podStartE2EDuration="2.026932042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:00:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:00:39.025131401 +0000 UTC m=+1953.554326075" watchObservedRunningTime="2026-10-31 08:00:39.026932042 +0000 UTC m=+1953.556126710"
Oct 31 08:00:47.991734 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:47.991686    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:48.004468 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:48.004437    5039 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:48.077849 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:00:48.077817    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:00:58.745482 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:00:58.745438    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:01:16.074232 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:16.074181    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"]
Oct 31 08:01:18.124859 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:18.124807    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"]
Oct 31 08:01:23.134242 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:23.134203    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-qrlhn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 08:01:23.134728 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:23.134452    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 08:01:28.696710 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:01:28.696666    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:01:31.097678 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.097630    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5" podUID="bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" containerName="main" containerID="cri-o://e1e333374c1f7d171fbc5dd64e54a2adf039499b7e9347720a8d739a8477a181" gracePeriod=45
Oct 31 08:01:31.381406 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.381309    5039 generic.go:356] "Generic (PLEG): container finished" podID="bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" containerID="e1e333374c1f7d171fbc5dd64e54a2adf039499b7e9347720a8d739a8477a181" exitCode=0
Oct 31 08:01:31.381581 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.381387    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5" event={"ID":"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb","Type":"ContainerDied","Data":"e1e333374c1f7d171fbc5dd64e54a2adf039499b7e9347720a8d739a8477a181"}
Oct 31 08:01:31.418976 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.418311    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:01:31.481666 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.479450    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-dshm\") pod \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") "
Oct 31 08:01:31.481666 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.479568    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tmp-dir\") pod \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") "
Oct 31 08:01:31.481666 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.479632    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-home\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-home\") pod \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") "
Oct 31 08:01:31.481666 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.479661    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tls-certs\") pod \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") "
Oct 31 08:01:31.481666 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.479728    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-kube-api-access-x9bkm\" (UniqueName: \"kubernetes.io/projected/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-kube-api-access-x9bkm\") pod \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") "
Oct 31 08:01:31.481666 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.479795    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-model-cache\") pod \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\" (UID: \"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb\") "
Oct 31 08:01:31.481666 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.480526    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-model-cache" pod "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" (UID: "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:01:31.481666 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.481531    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tmp-dir" pod "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" (UID: "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:01:31.481666 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.481613    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-home" pod "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" (UID: "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:01:31.528334 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.527982    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-kube-api-access-x9bkm" pod "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" (UID: "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb"). InnerVolumeSpecName "kube-api-access-x9bkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:01:31.528334 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.527991    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-dshm" pod "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" (UID: "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:01:31.528334 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.528277    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tls-certs" pod "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" (UID: "bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:01:31.580872 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.580827    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:31.580872 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.580863    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:31.580872 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.580872    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:31.580872 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.580880    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:31.580872 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.580888    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:31.581342 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:31.580896    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9bkm\" (UniqueName: \"kubernetes.io/projected/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb-kube-api-access-x9bkm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:32.414835 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:32.414770    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5" event={"ID":"bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb","Type":"ContainerDied","Data":"34c2348cb225b42aae475d2d52d992e4d29a1721866f1e4efa711b870151eb0d"}
Oct 31 08:01:32.415512 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:32.415488    5039 scope.go:122] "RemoveContainer" containerID="e1e333374c1f7d171fbc5dd64e54a2adf039499b7e9347720a8d739a8477a181"
Oct 31 08:01:32.415823 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:32.415802    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"
Oct 31 08:01:32.478942 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:32.470512    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"]
Oct 31 08:01:32.491383 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:32.491331    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-4a5b1e12-kserve-55f6785c8f-dv7j5"]
Oct 31 08:01:33.171049 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.170986    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl" podUID="2109310b-91e0-444f-981b-24a4708928d7" containerName="main" containerID="cri-o://1b90f632c18e7b4ebbdb5ad063c08b27fb517b9d97df03f79ebfa7ba7abcfdec" gracePeriod=45
Oct 31 08:01:33.423507 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.423407    5039 generic.go:356] "Generic (PLEG): container finished" podID="2109310b-91e0-444f-981b-24a4708928d7" containerID="1b90f632c18e7b4ebbdb5ad063c08b27fb517b9d97df03f79ebfa7ba7abcfdec" exitCode=0
Oct 31 08:01:33.423507 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.423489    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl" event={"ID":"2109310b-91e0-444f-981b-24a4708928d7","Type":"ContainerDied","Data":"1b90f632c18e7b4ebbdb5ad063c08b27fb517b9d97df03f79ebfa7ba7abcfdec"}
Oct 31 08:01:33.463770 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.463743    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:01:33.615300 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.615255    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" path="/var/lib/kubelet/pods/bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb/volumes"
Oct 31 08:01:33.630575 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.630535    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-model-cache\") pod \"2109310b-91e0-444f-981b-24a4708928d7\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") "
Oct 31 08:01:33.630772 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.630594    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-dshm\") pod \"2109310b-91e0-444f-981b-24a4708928d7\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") "
Oct 31 08:01:33.630772 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.630643    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2109310b-91e0-444f-981b-24a4708928d7-tls-certs\" (UniqueName: \"kubernetes.io/secret/2109310b-91e0-444f-981b-24a4708928d7-tls-certs\") pod \"2109310b-91e0-444f-981b-24a4708928d7\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") "
Oct 31 08:01:33.630772 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.630756    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2109310b-91e0-444f-981b-24a4708928d7-kube-api-access-v52dp\" (UniqueName: \"kubernetes.io/projected/2109310b-91e0-444f-981b-24a4708928d7-kube-api-access-v52dp\") pod \"2109310b-91e0-444f-981b-24a4708928d7\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") "
Oct 31 08:01:33.630985 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.630861    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-model-cache" pod "2109310b-91e0-444f-981b-24a4708928d7" (UID: "2109310b-91e0-444f-981b-24a4708928d7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:01:33.630985 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.630867    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-tmp-dir\") pod \"2109310b-91e0-444f-981b-24a4708928d7\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") "
Oct 31 08:01:33.631097 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.630990    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-home\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-home\") pod \"2109310b-91e0-444f-981b-24a4708928d7\" (UID: \"2109310b-91e0-444f-981b-24a4708928d7\") "
Oct 31 08:01:33.631150 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.631121    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-tmp-dir" pod "2109310b-91e0-444f-981b-24a4708928d7" (UID: "2109310b-91e0-444f-981b-24a4708928d7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:01:33.631245 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.631219    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-home" pod "2109310b-91e0-444f-981b-24a4708928d7" (UID: "2109310b-91e0-444f-981b-24a4708928d7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:01:33.631373 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.631355    5039 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-tmp-dir\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:33.631428 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.631378    5039 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-home\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:33.631428 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.631392    5039 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-model-cache\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:33.632950 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.632904    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2109310b-91e0-444f-981b-24a4708928d7-tls-certs" pod "2109310b-91e0-444f-981b-24a4708928d7" (UID: "2109310b-91e0-444f-981b-24a4708928d7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:01:33.633071 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.632951    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-dshm" pod "2109310b-91e0-444f-981b-24a4708928d7" (UID: "2109310b-91e0-444f-981b-24a4708928d7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:01:33.633071 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.633064    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2109310b-91e0-444f-981b-24a4708928d7-kube-api-access-v52dp" pod "2109310b-91e0-444f-981b-24a4708928d7" (UID: "2109310b-91e0-444f-981b-24a4708928d7"). InnerVolumeSpecName "kube-api-access-v52dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:01:33.732827 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.732791    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v52dp\" (UniqueName: \"kubernetes.io/projected/2109310b-91e0-444f-981b-24a4708928d7-kube-api-access-v52dp\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:33.732827 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.732824    5039 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2109310b-91e0-444f-981b-24a4708928d7-dshm\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:33.732827 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:33.732834    5039 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2109310b-91e0-444f-981b-24a4708928d7-tls-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:01:34.431639 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:34.431606    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"
Oct 31 08:01:34.432251 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:34.431642    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl" event={"ID":"2109310b-91e0-444f-981b-24a4708928d7","Type":"ContainerDied","Data":"d1d47dc2c43c7fef60b9c1d09f1f573f578248b7fc4af48594282806a4ff70c9"}
Oct 31 08:01:34.432251 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:34.431695    5039 scope.go:122] "RemoveContainer" containerID="1b90f632c18e7b4ebbdb5ad063c08b27fb517b9d97df03f79ebfa7ba7abcfdec"
Oct 31 08:01:34.478873 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:34.478835    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"]
Oct 31 08:01:34.489992 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:34.489958    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-4a5b1e12-kserve-6bd5fdcf45-gkxpl"]
Oct 31 08:01:35.615213 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:01:35.615182    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2109310b-91e0-444f-981b-24a4708928d7" path="/var/lib/kubelet/pods/2109310b-91e0-444f-981b-24a4708928d7/volumes"
Oct 31 08:01:58.702303 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:01:58.702212    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:02:26.315981 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.315938    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"]
Oct 31 08:02:26.316498 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.316478    5039 cpu_manager.go:414] "containerMap: removing container" podUID="bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" containerName="main"
Oct 31 08:02:26.316498 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.316493    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" containerName="main"
Oct 31 08:02:26.316609 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.316511    5039 cpu_manager.go:414] "containerMap: removing container" podUID="2109310b-91e0-444f-981b-24a4708928d7" containerName="main"
Oct 31 08:02:26.316609 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.316519    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2109310b-91e0-444f-981b-24a4708928d7" containerName="main"
Oct 31 08:02:26.316609 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.316602    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb0a0c0a-5d1a-4837-b33b-a1f669f2f3fb" containerName="main"
Oct 31 08:02:26.316766 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.316615    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="2109310b-91e0-444f-981b-24a4708928d7" containerName="main"
Oct 31 08:02:26.321247 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.321222    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.339133 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.339098    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"]
Oct 31 08:02:26.350067 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.350033    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4n7bj\""
Oct 31 08:02:26.350299 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.350277    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 31 08:02:26.350377 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.350311    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 08:02:26.380246 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.380207    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-metrics-certs\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.380425 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.380348    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brf78\" (UniqueName: \"kubernetes.io/projected/cea6f940-53d8-486b-bae8-f4a180899576-kube-api-access-brf78\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.380425 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.380387    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea6f940-53d8-486b-bae8-f4a180899576-openshift-service-ca\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.380425 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.380407    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-maas-api-tls\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.481282 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.481233    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-metrics-certs\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.481503 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.481308    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brf78\" (UniqueName: \"kubernetes.io/projected/cea6f940-53d8-486b-bae8-f4a180899576-kube-api-access-brf78\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.481503 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.481342    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea6f940-53d8-486b-bae8-f4a180899576-openshift-service-ca\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.481503 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.481368    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-maas-api-tls\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.482115 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.482087    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea6f940-53d8-486b-bae8-f4a180899576-openshift-service-ca\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.483909 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.483888    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-metrics-certs\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.484034 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.483982    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-maas-api-tls\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.499946 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.499884    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brf78\" (UniqueName: \"kubernetes.io/projected/cea6f940-53d8-486b-bae8-f4a180899576-kube-api-access-brf78\") pod \"maas-api-79fc8bc9c5-fn6ck\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") " pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.637580 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.637484    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:26.934103 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.934017    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"]
Oct 31 08:02:26.938173 ip-10-0-128-20 kubenswrapper[5039]: W1031 08:02:26.938142    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcea6f940_53d8_486b_bae8_f4a180899576.slice/crio-617a76ebea07e2660716acacc7c3ef89275ca58073214b2e9a1bca7a8432259c WatchSource:0}: Error finding container 617a76ebea07e2660716acacc7c3ef89275ca58073214b2e9a1bca7a8432259c: Status 404 returned error can't find the container with id 617a76ebea07e2660716acacc7c3ef89275ca58073214b2e9a1bca7a8432259c
Oct 31 08:02:26.939615 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:26.939592    5039 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 08:02:27.786529 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:27.786492    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck" event={"ID":"cea6f940-53d8-486b-bae8-f4a180899576","Type":"ContainerStarted","Data":"987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b"}
Oct 31 08:02:27.787051 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:27.786549    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck" event={"ID":"cea6f940-53d8-486b-bae8-f4a180899576","Type":"ContainerStarted","Data":"617a76ebea07e2660716acacc7c3ef89275ca58073214b2e9a1bca7a8432259c"}
Oct 31 08:02:27.787051 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:27.786580    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:27.824592 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:27.824541    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck" podStartSLOduration=1.415070347 podStartE2EDuration="1.824528423s" totalImagesPullingTime="409.458076ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:02:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:02:27.823295051 +0000 UTC m=+2062.352489706" watchObservedRunningTime="2026-10-31 08:02:27.824528423 +0000 UTC m=+2062.353723119"
Oct 31 08:02:28.697608 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:02:28.697569    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:02:33.794366 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:33.794322    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck" podUID="cea6f940-53d8-486b-bae8-f4a180899576" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.127:8443/health\": dial tcp 10.132.0.127:8443: connect: connection refused"
Oct 31 08:02:33.895795 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:33.895747    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"]
Oct 31 08:02:33.896049 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:33.896017    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck" podUID="cea6f940-53d8-486b-bae8-f4a180899576" containerName="maas-api" containerID="cri-o://987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b" gracePeriod=30
Oct 31 08:02:33.896909 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:33.896681    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck" podUID="cea6f940-53d8-486b-bae8-f4a180899576" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.127:8443/health\": dial tcp 10.132.0.127:8443: connect: connection refused"
Oct 31 08:02:33.929112 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:33.929074    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"]
Oct 31 08:02:33.932728 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:33.932703    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:33.953370 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:33.953328    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"]
Oct 31 08:02:34.057385 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.057299    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-maas-api-tls\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.057385 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.057351    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dlwm\" (UniqueName: \"kubernetes.io/projected/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-kube-api-access-6dlwm\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.057385 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.057382    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-metrics-certs\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.057609 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.057505    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-openshift-service-ca\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.154347 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.154317    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:34.158480 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.158449    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-metrics-certs\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.158590 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.158506    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-openshift-service-ca\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.158590 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.158574    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-maas-api-tls\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.158681 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.158602    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dlwm\" (UniqueName: \"kubernetes.io/projected/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-kube-api-access-6dlwm\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.159228 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.159199    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-openshift-service-ca\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.161214 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.161186    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-metrics-certs\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.161317 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.161196    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-maas-api-tls\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.176128 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.176096    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dlwm\" (UniqueName: \"kubernetes.io/projected/da37c2b4-4dfe-4f3c-93dd-26c942a79cb6-kube-api-access-6dlwm\") pod \"maas-api-f4d8b9659-ncxh7\" (UID: \"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6\") " pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.259587 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.259542    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-metrics-certs\") pod \"cea6f940-53d8-486b-bae8-f4a180899576\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") "
Oct 31 08:02:34.259798 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.259600    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cea6f940-53d8-486b-bae8-f4a180899576-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea6f940-53d8-486b-bae8-f4a180899576-openshift-service-ca\") pod \"cea6f940-53d8-486b-bae8-f4a180899576\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") "
Oct 31 08:02:34.259798 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.259666    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cea6f940-53d8-486b-bae8-f4a180899576-kube-api-access-brf78\" (UniqueName: \"kubernetes.io/projected/cea6f940-53d8-486b-bae8-f4a180899576-kube-api-access-brf78\") pod \"cea6f940-53d8-486b-bae8-f4a180899576\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") "
Oct 31 08:02:34.259798 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.259703    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-maas-api-tls\") pod \"cea6f940-53d8-486b-bae8-f4a180899576\" (UID: \"cea6f940-53d8-486b-bae8-f4a180899576\") "
Oct 31 08:02:34.260124 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.260098    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cea6f940-53d8-486b-bae8-f4a180899576-openshift-service-ca" pod "cea6f940-53d8-486b-bae8-f4a180899576" (UID: "cea6f940-53d8-486b-bae8-f4a180899576"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 08:02:34.261903 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.261874    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-metrics-certs" pod "cea6f940-53d8-486b-bae8-f4a180899576" (UID: "cea6f940-53d8-486b-bae8-f4a180899576"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:02:34.262056 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.261896    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-maas-api-tls" pod "cea6f940-53d8-486b-bae8-f4a180899576" (UID: "cea6f940-53d8-486b-bae8-f4a180899576"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:02:34.262056 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.261898    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cea6f940-53d8-486b-bae8-f4a180899576-kube-api-access-brf78" pod "cea6f940-53d8-486b-bae8-f4a180899576" (UID: "cea6f940-53d8-486b-bae8-f4a180899576"). InnerVolumeSpecName "kube-api-access-brf78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:02:34.281089 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.281058    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:34.360718 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.360679    5039 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-maas-api-tls\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:02:34.360718 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.360717    5039 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cea6f940-53d8-486b-bae8-f4a180899576-metrics-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:02:34.360984 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.360730    5039 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cea6f940-53d8-486b-bae8-f4a180899576-openshift-service-ca\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:02:34.360984 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.360749    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brf78\" (UniqueName: \"kubernetes.io/projected/cea6f940-53d8-486b-bae8-f4a180899576-kube-api-access-brf78\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:02:34.581222 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.581184    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"]
Oct 31 08:02:34.585818 ip-10-0-128-20 kubenswrapper[5039]: W1031 08:02:34.585754    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda37c2b4_4dfe_4f3c_93dd_26c942a79cb6.slice/crio-1b2fb99d3d4ce97d4ce3d65f691bd0aafa3f3bbc10eab95100d19e4b582eaf49 WatchSource:0}: Error finding container 1b2fb99d3d4ce97d4ce3d65f691bd0aafa3f3bbc10eab95100d19e4b582eaf49: Status 404 returned error can't find the container with id 1b2fb99d3d4ce97d4ce3d65f691bd0aafa3f3bbc10eab95100d19e4b582eaf49
Oct 31 08:02:34.826396 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.826359    5039 generic.go:356] "Generic (PLEG): container finished" podID="cea6f940-53d8-486b-bae8-f4a180899576" containerID="987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b" exitCode=2
Oct 31 08:02:34.826905 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.826410    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"
Oct 31 08:02:34.826905 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.826439    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck" event={"ID":"cea6f940-53d8-486b-bae8-f4a180899576","Type":"ContainerDied","Data":"987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b"}
Oct 31 08:02:34.826905 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.826496    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck" event={"ID":"cea6f940-53d8-486b-bae8-f4a180899576","Type":"ContainerDied","Data":"617a76ebea07e2660716acacc7c3ef89275ca58073214b2e9a1bca7a8432259c"}
Oct 31 08:02:34.826905 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.826530    5039 scope.go:122] "RemoveContainer" containerID="987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b"
Oct 31 08:02:34.827971 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.827943    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7" event={"ID":"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6","Type":"ContainerStarted","Data":"1b2fb99d3d4ce97d4ce3d65f691bd0aafa3f3bbc10eab95100d19e4b582eaf49"}
Oct 31 08:02:34.836951 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.836930    5039 scope.go:122] "RemoveContainer" containerID="987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b"
Oct 31 08:02:34.837257 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:02:34.837234    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b\": container with ID starting with 987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b not found: ID does not exist" containerID="987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b"
Oct 31 08:02:34.837305 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.837267    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b"} err="failed to get container status \"987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b\": rpc error: code = NotFound desc = could not find container \"987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b\": container with ID starting with 987bae8527c90cef61a3cc9c1fbcf3c0817e5648eb9469f888f79f5dbb00880b not found: ID does not exist"
Oct 31 08:02:34.874348 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.874311    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"]
Oct 31 08:02:34.885507 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:34.885471    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-79fc8bc9c5-fn6ck"]
Oct 31 08:02:35.614893 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:35.614853    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cea6f940-53d8-486b-bae8-f4a180899576" path="/var/lib/kubelet/pods/cea6f940-53d8-486b-bae8-f4a180899576/volumes"
Oct 31 08:02:35.836343 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:35.836307    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7" event={"ID":"da37c2b4-4dfe-4f3c-93dd-26c942a79cb6","Type":"ContainerStarted","Data":"c2121b5a8c5bedd02543c26252d24f20f7ecef8d8ecd525cb93fb0a63d478b46"}
Oct 31 08:02:35.836750 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:35.836423    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:35.874453 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:35.874351    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7" podStartSLOduration=2.553639951 podStartE2EDuration="2.874336651s" totalImagesPullingTime="320.6967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:02:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:02:35.873314469 +0000 UTC m=+2070.402509144" watchObservedRunningTime="2026-10-31 08:02:35.874336651 +0000 UTC m=+2070.403531360"
Oct 31 08:02:41.848328 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:02:41.848294    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f4d8b9659-ncxh7"
Oct 31 08:02:58.697258 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:02:58.697215    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:03:05.957705 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:03:05.957675    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 08:03:05.963284 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:03:05.963252    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 08:03:05.970434 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:03:05.970408    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 08:03:05.975632 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:03:05.975606    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 08:03:28.697476 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:03:28.697390    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:03:41.386261 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:03:41.386191    5039 prober.go:122] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-20.ec2.internal" podUID="e7ef466d4952ee7684f323b6e3eda034" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 08:03:58.697660 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:03:58.697610    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:04:28.696889 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:04:28.696843    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:04:58.696416 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:04:58.696334    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:05:28.696043 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:05:28.695996    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:05:58.697275 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:05:58.697234    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:06:28.698971 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:06:28.698850    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:06:58.695356 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:06:58.695312    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:07:22.549747 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:07:22.549707    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fdb76d5d4-wm9p4_d82261f3-4787-4a3a-aa06-c082ffb2116e/authorino/0.log"
Oct 31 08:07:28.696957 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:07:28.696887    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:07:53.074404 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:07:53.074313    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-7vcs5_85f328eb-ec63-43e1-b042-c8802531e222/manager/0.log"
Oct 31 08:07:53.537509 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:07:53.537477    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-82fjs_d7fa6638-6657-4a9c-8ffe-d0b933d2382b/manager/0.log"
Oct 31 08:07:58.698049 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:07:58.698000    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:08:04.142647 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:04.142569    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-khttk_7ab4eb59-90ae-4d88-98c8-06cb22a6cc66/server/0.log"
Oct 31 08:08:04.357608 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:04.357577    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-cp4r2_a357159f-963c-45e8-bde4-7b2aab5a158e/manager/0.log"
Oct 31 08:08:05.314305 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:05.314270    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f4d8b9659-ncxh7_da37c2b4-4dfe-4f3c-93dd-26c942a79cb6/maas-api/0.log"
Oct 31 08:08:05.997352 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:05.997323    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 08:08:06.005486 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:06.005457    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 08:08:06.009323 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:06.009299    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 08:08:06.016852 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:06.016829    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 08:08:06.253174 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:06.253095    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-8fr55_bf86884b-19ca-402f-8ac1-1c822ffedcc6/postgres/0.log"
Oct 31 08:08:17.693211 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:17.693178    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fdb76d5d4-wm9p4_d82261f3-4787-4a3a-aa06-c082ffb2116e/authorino/0.log"
Oct 31 08:08:17.937145 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:17.937111    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-qqmkf_f0af3ad7-81bf-4c14-8804-c19890d0c3e4/manager/0.log"
Oct 31 08:08:18.126231 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:18.126183    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-m6lgz_f98ac879-e396-47a6-8c2e-52de86730d92/manager/0.log"
Oct 31 08:08:18.935191 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:18.935150    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-pk5mk_10509ed9-43ef-4192-ab5e-8810571c1f5e/manager/0.log"
Oct 31 08:08:28.696526 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:08:28.696479    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:08:29.717200 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:29.717166    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-848cd468bf6xwgj_c466db13-469b-488f-bf26-5229a2bcbb49/istio-proxy/0.log"
Oct 31 08:08:31.700577 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:31.700545    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-qrlhn_0a62bb58-a916-47ac-94ff-c2c9f3440fbc/istio-proxy/0.log"
Oct 31 08:08:31.894284 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:31.894252    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-rlbjc_c23943ef-97b5-4c73-ac3e-3c664fe88ad5/istio-proxy/0.log"
Oct 31 08:08:32.081224 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:32.081186    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-rxdnz_7942b45d-8533-4089-a961-751c59ba0591/istio-proxy/1.log"
Oct 31 08:08:32.435202 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:32.435119    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5_61c6b83e-0379-440f-a69e-05b0d988b9a1/istio-proxy/0.log"
Oct 31 08:08:32.972273 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:32.972239    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79b9f58c8f-wd2zk_4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/router/0.log"
Oct 31 08:08:33.393814 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:33.393726    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-rxdnz_7942b45d-8533-4089-a961-751c59ba0591/istio-proxy/0.log"
Oct 31 08:08:36.112269 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:08:36.112231    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fdb76d5d4-wm9p4_d82261f3-4787-4a3a-aa06-c082ffb2116e/authorino/0.log"
Oct 31 08:08:58.696109 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:08:58.696067    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:09:15.306451 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:15.306413    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-7vcs5_85f328eb-ec63-43e1-b042-c8802531e222/manager/0.log"
Oct 31 08:09:25.737070 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:25.736983    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-82fjs_d7fa6638-6657-4a9c-8ffe-d0b933d2382b/manager/0.log"
Oct 31 08:09:26.211866 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:26.211838    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-khttk_7ab4eb59-90ae-4d88-98c8-06cb22a6cc66/server/0.log"
Oct 31 08:09:26.409771 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:26.409736    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-cp4r2_a357159f-963c-45e8-bde4-7b2aab5a158e/manager/0.log"
Oct 31 08:09:27.144679 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:27.144642    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-f4d8b9659-ncxh7_da37c2b4-4dfe-4f3c-93dd-26c942a79cb6/maas-api/0.log"
Oct 31 08:09:28.695636 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:09:28.695601    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:09:38.108170 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:38.108125    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-8fr55_bf86884b-19ca-402f-8ac1-1c822ffedcc6/postgres/0.log"
Oct 31 08:09:39.221716 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:39.221678    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fdb76d5d4-wm9p4_d82261f3-4787-4a3a-aa06-c082ffb2116e/authorino/0.log"
Oct 31 08:09:39.466112 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:39.466075    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-qqmkf_f0af3ad7-81bf-4c14-8804-c19890d0c3e4/manager/0.log"
Oct 31 08:09:39.656010 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:39.655891    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-m6lgz_f98ac879-e396-47a6-8c2e-52de86730d92/manager/0.log"
Oct 31 08:09:40.434822 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:40.434778    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-pk5mk_10509ed9-43ef-4192-ab5e-8810571c1f5e/manager/0.log"
Oct 31 08:09:40.996464 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:40.996431    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-848cd468bf6xwgj_c466db13-469b-488f-bf26-5229a2bcbb49/istio-proxy/0.log"
Oct 31 08:09:42.875165 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:42.875135    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-qrlhn_0a62bb58-a916-47ac-94ff-c2c9f3440fbc/istio-proxy/0.log"
Oct 31 08:09:43.048818 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:43.048782    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-rlbjc_c23943ef-97b5-4c73-ac3e-3c664fe88ad5/istio-proxy/0.log"
Oct 31 08:09:43.240313 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:43.240276    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-645cf464d7-rxdnz_7942b45d-8533-4089-a961-751c59ba0591/istio-proxy/1.log"
Oct 31 08:09:43.606198 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:43.606119    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5_61c6b83e-0379-440f-a69e-05b0d988b9a1/istio-proxy/0.log"
Oct 31 08:09:44.159772 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:09:44.159741    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79b9f58c8f-wd2zk_4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/router/0.log"
Oct 31 08:09:58.696303 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:09:58.696260    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:10:28.697706 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:10:28.697664    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:10:58.696428 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:10:58.696336    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:11:28.696759 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:11:28.696714    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:11:58.696635 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:11:58.696590    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:12:28.696102 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:12:28.696007    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:12:46.309644 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:46.309595    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"]
Oct 31 08:12:46.310199 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:46.309820    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy" containerID="cri-o://46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f" gracePeriod=30
Oct 31 08:12:51.569579 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.569550    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 08:12:51.620122 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.620054    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-envoy\") pod \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") "
Oct 31 08:12:51.620122 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.620096    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istiod-ca-cert\") pod \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") "
Oct 31 08:12:51.620551 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.620524    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istiod-ca-cert" pod "0a62bb58-a916-47ac-94ff-c2c9f3440fbc" (UID: "0a62bb58-a916-47ac-94ff-c2c9f3440fbc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 08:12:51.622489 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.622461    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-envoy" pod "0a62bb58-a916-47ac-94ff-c2c9f3440fbc" (UID: "0a62bb58-a916-47ac-94ff-c2c9f3440fbc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:12:51.720533 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720495    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-socket\") pod \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") "
Oct 31 08:12:51.720719 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720558    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-data\") pod \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") "
Oct 31 08:12:51.720719 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720616    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-credential-socket\") pod \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") "
Oct 31 08:12:51.720719 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720659    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-kube-api-access-ddtq4\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-kube-api-access-ddtq4\") pod \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") "
Oct 31 08:12:51.720719 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720691    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-certs\") pod \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") "
Oct 31 08:12:51.720983 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720743    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-token\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-token\") pod \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") "
Oct 31 08:12:51.720983 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720790    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-socket" pod "0a62bb58-a916-47ac-94ff-c2c9f3440fbc" (UID: "0a62bb58-a916-47ac-94ff-c2c9f3440fbc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:12:51.720983 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720824    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-podinfo\") pod \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\" (UID: \"0a62bb58-a916-47ac-94ff-c2c9f3440fbc\") "
Oct 31 08:12:51.720983 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720859    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-data" pod "0a62bb58-a916-47ac-94ff-c2c9f3440fbc" (UID: "0a62bb58-a916-47ac-94ff-c2c9f3440fbc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:12:51.720983 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.720909    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-credential-socket" pod "0a62bb58-a916-47ac-94ff-c2c9f3440fbc" (UID: "0a62bb58-a916-47ac-94ff-c2c9f3440fbc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:12:51.721240 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.721125    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:12:51.721240 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.721156    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:12:51.721240 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.721168    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:12:51.721240 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.721176    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:12:51.721240 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.721184    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:12:51.721240 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.721119    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-certs" pod "0a62bb58-a916-47ac-94ff-c2c9f3440fbc" (UID: "0a62bb58-a916-47ac-94ff-c2c9f3440fbc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:12:51.723070 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.723041    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-podinfo" pod "0a62bb58-a916-47ac-94ff-c2c9f3440fbc" (UID: "0a62bb58-a916-47ac-94ff-c2c9f3440fbc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 08:12:51.723216 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.723096    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-token" pod "0a62bb58-a916-47ac-94ff-c2c9f3440fbc" (UID: "0a62bb58-a916-47ac-94ff-c2c9f3440fbc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:12:51.723216 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.723150    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-kube-api-access-ddtq4" pod "0a62bb58-a916-47ac-94ff-c2c9f3440fbc" (UID: "0a62bb58-a916-47ac-94ff-c2c9f3440fbc"). InnerVolumeSpecName "kube-api-access-ddtq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:12:51.821628 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.821587    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddtq4\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-kube-api-access-ddtq4\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:12:51.821628 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.821625    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:12:51.821628 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.821635    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:12:51.821889 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:51.821643    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a62bb58-a916-47ac-94ff-c2c9f3440fbc-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:12:52.378184 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:52.378150    5039 generic.go:356] "Generic (PLEG): container finished" podID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerID="46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f" exitCode=0
Oct 31 08:12:52.378402 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:52.378199    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"
Oct 31 08:12:52.378402 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:52.378232    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" event={"ID":"0a62bb58-a916-47ac-94ff-c2c9f3440fbc","Type":"ContainerDied","Data":"46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f"}
Oct 31 08:12:52.378402 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:52.378317    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn" event={"ID":"0a62bb58-a916-47ac-94ff-c2c9f3440fbc","Type":"ContainerDied","Data":"3c8c1795420f1f034bd039968fbe04cd85b3193c831a22efe80973318a334f63"}
Oct 31 08:12:52.378402 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:52.378348    5039 scope.go:122] "RemoveContainer" containerID="46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f"
Oct 31 08:12:52.389017 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:52.388997    5039 scope.go:122] "RemoveContainer" containerID="46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f"
Oct 31 08:12:52.389315 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:12:52.389292    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f\": container with ID starting with 46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f not found: ID does not exist" containerID="46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f"
Oct 31 08:12:52.389380 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:52.389325    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f"} err="failed to get container status \"46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f\": rpc error: code = NotFound desc = could not find container \"46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f\": container with ID starting with 46fe6f2a08beec66f04c5d1235dbfbd9bb9b15edd52d7c377febedd534744f1f not found: ID does not exist"
Oct 31 08:12:52.437556 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:52.437524    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"]
Oct 31 08:12:52.448802 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:52.448771    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-qrlhn"]
Oct 31 08:12:53.615023 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:12:53.614991    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" path="/var/lib/kubelet/pods/0a62bb58-a916-47ac-94ff-c2c9f3440fbc/volumes"
Oct 31 08:12:58.695401 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:12:58.695352    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:13:01.352236 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:01.352188    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"]
Oct 31 08:13:01.352734 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:01.352444    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy" containerID="cri-o://e3b9e92bfeb538a546470dcdc91dc54647e8aaaf1d82f30e34d3de41c0653b13" gracePeriod=30
Oct 31 08:13:01.363554 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:01.363489    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"]
Oct 31 08:13:01.364224 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:01.363764    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy" containerID="cri-o://151d664300c6f9aced367489eae14eb5914c6a89dfa64e666135c4e5997bc227" gracePeriod=30
Oct 31 08:13:05.880279 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:05.880230    5039 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-645cf464d7-rlbjc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 08:13:05.880760 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:05.880300    5039 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 08:13:06.037932 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.037886    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 08:13:06.048259 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.048214    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-marketplace_e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712rwm2_d47f13b7-997a-4707-8ed3-288a15508dad/extract/0.log"
Oct 31 08:13:06.050702 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.050672    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 08:13:06.060143 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.060113    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 08:13:06.623719 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.623652    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 08:13:06.650140 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.650110    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 08:13:06.652289 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.652264    5039 scope.go:122] "RemoveContainer" containerID="151d664300c6f9aced367489eae14eb5914c6a89dfa64e666135c4e5997bc227"
Oct 31 08:13:06.661888 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.661863    5039 scope.go:122] "RemoveContainer" containerID="11c73a1f3805424265493b2634d572e7bf6c97754bb10341f50000c8dbfc5da5"
Oct 31 08:13:06.667418 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667389    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-certs\") pod \"7942b45d-8533-4089-a961-751c59ba0591\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") "
Oct 31 08:13:06.667557 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667448    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7942b45d-8533-4089-a961-751c59ba0591-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7942b45d-8533-4089-a961-751c59ba0591-istio-podinfo\") pod \"7942b45d-8533-4089-a961-751c59ba0591\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") "
Oct 31 08:13:06.667557 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667478    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-kube-api-access-76nzh\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-kube-api-access-76nzh\") pod \"7942b45d-8533-4089-a961-751c59ba0591\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") "
Oct 31 08:13:06.667557 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667513    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-socket\") pod \"7942b45d-8533-4089-a961-751c59ba0591\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") "
Oct 31 08:13:06.667557 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667538    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-envoy\") pod \"7942b45d-8533-4089-a961-751c59ba0591\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") "
Oct 31 08:13:06.667814 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667559    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-istio-token\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-istio-token\") pod \"7942b45d-8533-4089-a961-751c59ba0591\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") "
Oct 31 08:13:06.667814 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667600    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-data\") pod \"7942b45d-8533-4089-a961-751c59ba0591\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") "
Oct 31 08:13:06.667814 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667628    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-credential-socket\") pod \"7942b45d-8533-4089-a961-751c59ba0591\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") "
Oct 31 08:13:06.667814 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667686    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7942b45d-8533-4089-a961-751c59ba0591-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7942b45d-8533-4089-a961-751c59ba0591-istiod-ca-cert\") pod \"7942b45d-8533-4089-a961-751c59ba0591\" (UID: \"7942b45d-8533-4089-a961-751c59ba0591\") "
Oct 31 08:13:06.668121 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.667860    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-socket" pod "7942b45d-8533-4089-a961-751c59ba0591" (UID: "7942b45d-8533-4089-a961-751c59ba0591"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.668121 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.668054    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-data" pod "7942b45d-8533-4089-a961-751c59ba0591" (UID: "7942b45d-8533-4089-a961-751c59ba0591"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.668121 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.668115    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.668284 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.668218    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-credential-socket" pod "7942b45d-8533-4089-a961-751c59ba0591" (UID: "7942b45d-8533-4089-a961-751c59ba0591"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.668359 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.668286    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-certs" pod "7942b45d-8533-4089-a961-751c59ba0591" (UID: "7942b45d-8533-4089-a961-751c59ba0591"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.668359 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.668302    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7942b45d-8533-4089-a961-751c59ba0591-istiod-ca-cert" pod "7942b45d-8533-4089-a961-751c59ba0591" (UID: "7942b45d-8533-4089-a961-751c59ba0591"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 08:13:06.670052 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.670024    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-istio-token" pod "7942b45d-8533-4089-a961-751c59ba0591" (UID: "7942b45d-8533-4089-a961-751c59ba0591"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:13:06.670250 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.670231    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-envoy" pod "7942b45d-8533-4089-a961-751c59ba0591" (UID: "7942b45d-8533-4089-a961-751c59ba0591"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.670318 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.670281    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7942b45d-8533-4089-a961-751c59ba0591-istio-podinfo" pod "7942b45d-8533-4089-a961-751c59ba0591" (UID: "7942b45d-8533-4089-a961-751c59ba0591"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 08:13:06.670318 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.670294    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-kube-api-access-76nzh" pod "7942b45d-8533-4089-a961-751c59ba0591" (UID: "7942b45d-8533-4089-a961-751c59ba0591"). InnerVolumeSpecName "kube-api-access-76nzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:13:06.671942 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.671910    5039 scope.go:122] "RemoveContainer" containerID="e3b9e92bfeb538a546470dcdc91dc54647e8aaaf1d82f30e34d3de41c0653b13"
Oct 31 08:13:06.769223 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769185    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-socket\") pod \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") "
Oct 31 08:13:06.769223 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769237    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-data\") pod \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") "
Oct 31 08:13:06.769502 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769264    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-certs\") pod \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") "
Oct 31 08:13:06.769502 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769290    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-podinfo\") pod \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") "
Oct 31 08:13:06.769502 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769319    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-token\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-token\") pod \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") "
Oct 31 08:13:06.769502 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769348    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-credential-socket\") pod \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") "
Oct 31 08:13:06.769502 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769397    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-kube-api-access-pkhc7\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-kube-api-access-pkhc7\") pod \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") "
Oct 31 08:13:06.769502 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769485    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istiod-ca-cert\") pod \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") "
Oct 31 08:13:06.769838 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769544    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-envoy\") pod \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\" (UID: \"c23943ef-97b5-4c73-ac3e-3c664fe88ad5\") "
Oct 31 08:13:06.769838 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769548    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-socket" pod "c23943ef-97b5-4c73-ac3e-3c664fe88ad5" (UID: "c23943ef-97b5-4c73-ac3e-3c664fe88ad5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.769838 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769562    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-data" pod "c23943ef-97b5-4c73-ac3e-3c664fe88ad5" (UID: "c23943ef-97b5-4c73-ac3e-3c664fe88ad5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.769838 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769663    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-certs" pod "c23943ef-97b5-4c73-ac3e-3c664fe88ad5" (UID: "c23943ef-97b5-4c73-ac3e-3c664fe88ad5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.769838 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769814    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-credential-socket" pod "c23943ef-97b5-4c73-ac3e-3c664fe88ad5" (UID: "c23943ef-97b5-4c73-ac3e-3c664fe88ad5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769976    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7942b45d-8533-4089-a961-751c59ba0591-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.769991    5039 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770000    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770012    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770041    5039 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-workload-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770056    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770073    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7942b45d-8533-4089-a961-751c59ba0591-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770086    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76nzh\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-kube-api-access-76nzh\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770007    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istiod-ca-cert" pod "c23943ef-97b5-4c73-ac3e-3c664fe88ad5" (UID: "c23943ef-97b5-4c73-ac3e-3c664fe88ad5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770099    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770142 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770145    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7942b45d-8533-4089-a961-751c59ba0591-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770571 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770163    5039 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-istio-data\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.770571 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.770179    5039 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7942b45d-8533-4089-a961-751c59ba0591-credential-socket\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.771833 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.771795    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-envoy" pod "c23943ef-97b5-4c73-ac3e-3c664fe88ad5" (UID: "c23943ef-97b5-4c73-ac3e-3c664fe88ad5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 08:13:06.771833 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.771827    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-kube-api-access-pkhc7" pod "c23943ef-97b5-4c73-ac3e-3c664fe88ad5" (UID: "c23943ef-97b5-4c73-ac3e-3c664fe88ad5"). InnerVolumeSpecName "kube-api-access-pkhc7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:13:06.772089 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.772071    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-token" pod "c23943ef-97b5-4c73-ac3e-3c664fe88ad5" (UID: "c23943ef-97b5-4c73-ac3e-3c664fe88ad5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:13:06.772184 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.772166    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-podinfo" pod "c23943ef-97b5-4c73-ac3e-3c664fe88ad5" (UID: "c23943ef-97b5-4c73-ac3e-3c664fe88ad5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 08:13:06.871008 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.870969    5039 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-envoy\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.871008 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.871001    5039 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-podinfo\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.871008 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.871010    5039 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istio-token\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.871262 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.871019    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkhc7\" (UniqueName: \"kubernetes.io/projected/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-kube-api-access-pkhc7\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:06.871262 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:06.871032    5039 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c23943ef-97b5-4c73-ac3e-3c664fe88ad5-istiod-ca-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:13:07.476240 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.476193    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" event={"ID":"7942b45d-8533-4089-a961-751c59ba0591","Type":"ContainerDied","Data":"e3b9e92bfeb538a546470dcdc91dc54647e8aaaf1d82f30e34d3de41c0653b13"}
Oct 31 08:13:07.476662 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.476256    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"
Oct 31 08:13:07.476662 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.476290    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz" event={"ID":"7942b45d-8533-4089-a961-751c59ba0591","Type":"ContainerDied","Data":"1048df5a8f7d356e1f197524b4d489aa1adb917de3ebc3ecb9adf92faffb8bf6"}
Oct 31 08:13:07.476662 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.476310    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" event={"ID":"c23943ef-97b5-4c73-ac3e-3c664fe88ad5","Type":"ContainerDied","Data":"151d664300c6f9aced367489eae14eb5914c6a89dfa64e666135c4e5997bc227"}
Oct 31 08:13:07.476662 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.476328    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc" event={"ID":"c23943ef-97b5-4c73-ac3e-3c664fe88ad5","Type":"ContainerDied","Data":"14ab35b1750e920314f489c9eb7ece5f60487c8b36cd326e04089b959fb471f4"}
Oct 31 08:13:07.476662 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.476256    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"
Oct 31 08:13:07.615564 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.615535    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"]
Oct 31 08:13:07.615744 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.615575    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rxdnz"]
Oct 31 08:13:07.646281 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.646193    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"]
Oct 31 08:13:07.649405 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:07.649373    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-645cf464d7-rlbjc"]
Oct 31 08:13:09.615851 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:09.615812    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7942b45d-8533-4089-a961-751c59ba0591" path="/var/lib/kubelet/pods/7942b45d-8533-4089-a961-751c59ba0591/volumes"
Oct 31 08:13:09.616297 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:13:09.616282    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" path="/var/lib/kubelet/pods/c23943ef-97b5-4c73-ac3e-3c664fe88ad5/volumes"
Oct 31 08:13:28.695196 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:13:28.695159    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:13:58.695886 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:13:58.695837    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:14:14.951585 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:14.951528    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qpskk_21fea0a5-efb9-4b1a-b561-d173b3ad6169/global-pull-secret-syncer/0.log"
Oct 31 08:14:15.264431 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:15.264400    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-2qw6l_735f0bbc-22c2-4f33-af0d-6fc10cda9e17/connection-checker/0.log"
Oct 31 08:14:15.379973 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:15.379941    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-r4hl6_4167bdf8-9b23-482d-805f-c6fdeeda5384/connection-checker/0.log"
Oct 31 08:14:15.495289 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:15.495262    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kas-connection-checker-685895c7c9-zl6kk_a7f02f3f-6e1b-4449-a766-90dfe0ab8cbb/connection-checker/0.log"
Oct 31 08:14:15.648541 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:15.648446    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kwmnp_e9d4b049-ebbe-4c4f-b792-d74110bc6ec0/konnectivity-agent/0.log"
Oct 31 08:14:16.010372 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:16.010339    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-20.ec2.internal_e7ef466d4952ee7684f323b6e3eda034/haproxy/0.log"
Oct 31 08:14:22.052243 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:22.052198    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5fdb76d5d4-wm9p4_d82261f3-4787-4a3a-aa06-c082ffb2116e/authorino/0.log"
Oct 31 08:14:22.145195 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:22.145159    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-qqmkf_f0af3ad7-81bf-4c14-8804-c19890d0c3e4/manager/0.log"
Oct 31 08:14:22.254559 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:22.254510    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-m6lgz_f98ac879-e396-47a6-8c2e-52de86730d92/manager/0.log"
Oct 31 08:14:22.769397 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:22.769360    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-pk5mk_10509ed9-43ef-4192-ab5e-8810571c1f5e/manager/0.log"
Oct 31 08:14:23.924744 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.924705    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"]
Oct 31 08:14:23.925321 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925210    5039 cpu_manager.go:414] "containerMap: removing container" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy"
Oct 31 08:14:23.925321 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925229    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy"
Oct 31 08:14:23.925321 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925281    5039 cpu_manager.go:414] "containerMap: removing container" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy"
Oct 31 08:14:23.925321 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925290    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy"
Oct 31 08:14:23.925321 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925306    5039 cpu_manager.go:414] "containerMap: removing container" podUID="cea6f940-53d8-486b-bae8-f4a180899576" containerName="maas-api"
Oct 31 08:14:23.925321 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925313    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cea6f940-53d8-486b-bae8-f4a180899576" containerName="maas-api"
Oct 31 08:14:23.925621 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925336    5039 cpu_manager.go:414] "containerMap: removing container" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy"
Oct 31 08:14:23.925621 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925343    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy"
Oct 31 08:14:23.925621 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925434    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="cea6f940-53d8-486b-bae8-f4a180899576" containerName="maas-api"
Oct 31 08:14:23.925621 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925450    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="0a62bb58-a916-47ac-94ff-c2c9f3440fbc" containerName="istio-proxy"
Oct 31 08:14:23.925621 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925458    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy"
Oct 31 08:14:23.925621 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925463    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="c23943ef-97b5-4c73-ac3e-3c664fe88ad5" containerName="istio-proxy"
Oct 31 08:14:23.925621 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.925473    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy"
Oct 31 08:14:23.928717 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.928697    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:23.948246 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.948220    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"]
Oct 31 08:14:23.954806 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.954783    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pl6m9\"/\"openshift-service-ca.crt\""
Oct 31 08:14:23.957758 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.955352    5039 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pl6m9\"/\"kube-root-ca.crt\""
Oct 31 08:14:23.957758 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:23.955430    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pl6m9\"/\"default-dockercfg-gs2j4\""
Oct 31 08:14:24.057725 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.057685    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djbck\" (UniqueName: \"kubernetes.io/projected/63aac912-6cb3-45b7-bcfc-c9438ada6a46-kube-api-access-djbck\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.057725 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.057728    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-proc\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.057959 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.057811    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-lib-modules\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.057959 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.057859    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-podres\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.058036 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.057958    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-sys\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.159241 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.159200    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djbck\" (UniqueName: \"kubernetes.io/projected/63aac912-6cb3-45b7-bcfc-c9438ada6a46-kube-api-access-djbck\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.159241 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.159241    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-proc\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.159452 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.159317    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-proc\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.159452 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.159346    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-lib-modules\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.159452 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.159372    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-podres\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.159452 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.159400    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-sys\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.159605 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.159466    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-sys\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.159605 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.159478    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-lib-modules\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.159605 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.159495    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/63aac912-6cb3-45b7-bcfc-c9438ada6a46-podres\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.177065 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.176998    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djbck\" (UniqueName: \"kubernetes.io/projected/63aac912-6cb3-45b7-bcfc-c9438ada6a46-kube-api-access-djbck\") pod \"perf-node-gather-daemonset-zbht9\" (UID: \"63aac912-6cb3-45b7-bcfc-c9438ada6a46\") " pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.240760 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.240726    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.536734 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.536697    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"]
Oct 31 08:14:24.542348 ip-10-0-128-20 kubenswrapper[5039]: W1031 08:14:24.542317    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod63aac912_6cb3_45b7_bcfc_c9438ada6a46.slice/crio-bc6c7fb98a9f053d53c9666db50ba4e0fd2ff6e38d1bf42b5b62dffa0fd883d3 WatchSource:0}: Error finding container bc6c7fb98a9f053d53c9666db50ba4e0fd2ff6e38d1bf42b5b62dffa0fd883d3: Status 404 returned error can't find the container with id bc6c7fb98a9f053d53c9666db50ba4e0fd2ff6e38d1bf42b5b62dffa0fd883d3
Oct 31 08:14:24.837443 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.837354    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-884576c57-84prv_078fdc95-76b1-4323-9985-905f939dbbc4/cluster-monitoring-operator/0.log"
Oct 31 08:14:24.892528 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.892489    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9" event={"ID":"63aac912-6cb3-45b7-bcfc-c9438ada6a46","Type":"ContainerStarted","Data":"ea6b172fdba2004d2e66b46721704b671810db5c4330a2485231b7afb032fe62"}
Oct 31 08:14:24.892711 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.892550    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:24.892711 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.892567    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9" event={"ID":"63aac912-6cb3-45b7-bcfc-c9438ada6a46","Type":"ContainerStarted","Data":"bc6c7fb98a9f053d53c9666db50ba4e0fd2ff6e38d1bf42b5b62dffa0fd883d3"}
Oct 31 08:14:24.928924 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:24.928856    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9" podStartSLOduration=1.928816797 podStartE2EDuration="1.928816797s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 08:14:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:14:24.926632759 +0000 UTC m=+2779.455827432" watchObservedRunningTime="2026-10-31 08:14:24.928816797 +0000 UTC m=+2779.458011467"
Oct 31 08:14:26.142319 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:26.142272    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfsww_4f90b6fc-a211-44aa-b021-f2dab5fcdf22/node-exporter/0.log"
Oct 31 08:14:26.246386 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:26.246356    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfsww_4f90b6fc-a211-44aa-b021-f2dab5fcdf22/kube-rbac-proxy/0.log"
Oct 31 08:14:26.350479 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:26.350442    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-hfsww_4f90b6fc-a211-44aa-b021-f2dab5fcdf22/init-textfile/0.log"
Oct 31 08:14:28.695375 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:14:28.695336    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:14:30.064884 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:30.064843    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-86c478bb88-pplb8_2a867c49-34bc-4114-8ee9-c3f30900d501/networking-console-plugin/0.log"
Oct 31 08:14:30.908098 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:30.908065    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pl6m9/perf-node-gather-daemonset-zbht9"
Oct 31 08:14:31.029729 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:31.029697    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/1.log"
Oct 31 08:14:31.033727 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:31.033701    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7cd56b8dbc-bqnjc_ccea0fe7-8780-408e-b799-299e44328b4f/console-operator/2.log"
Oct 31 08:14:33.020146 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:33.020117    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-58c9f5f46d-g72nq_680bd2c4-08ae-4e24-a6c0-37339d826971/volume-data-source-validator/0.log"
Oct 31 08:14:34.865851 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:34.865816    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4zz8_e248978c-acdb-47f0-b702-c0029711230d/dns/0.log"
Oct 31 08:14:34.967949 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:34.967909    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b4zz8_e248978c-acdb-47f0-b702-c0029711230d/kube-rbac-proxy/0.log"
Oct 31 08:14:35.610853 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:35.610824    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzt8h_408136c3-732d-4564-a1f8-c969888f361d/dns-node-resolver/0.log"
Oct 31 08:14:36.826093 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:36.826056    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8498p_f2d1eb29-7f18-41ee-949d-33892c4b30c1/node-ca/0.log"
Oct 31 08:14:38.647105 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:38.647070    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-848cd468bf6xwgj_c466db13-469b-488f-bf26-5229a2bcbb49/istio-proxy/0.log"
Oct 31 08:14:40.326195 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:40.326159    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5_61c6b83e-0379-440f-a69e-05b0d988b9a1/istio-proxy/0.log"
Oct 31 08:14:40.653298 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:40.653223    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79b9f58c8f-wd2zk_4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/router/0.log"
Oct 31 08:14:42.275858 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:42.275806    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rw59c_5d6e9a9a-37e4-4f68-975d-fada2cfc80ec/serve-healthcheck-canary/0.log"
Oct 31 08:14:43.200122 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:43.200087    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-6krlj_904b6555-9c6d-4489-9b17-0d96d5fe2c12/insights-operator/1.log"
Oct 31 08:14:43.201823 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:43.201803    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-7c4986d449-6krlj_904b6555-9c6d-4489-9b17-0d96d5fe2c12/insights-operator/2.log"
Oct 31 08:14:43.624576 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:43.624544    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98qs2_25eb80fc-fccc-4c7e-8e18-21d4afc76c55/kube-rbac-proxy/0.log"
Oct 31 08:14:43.728051 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:43.728011    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98qs2_25eb80fc-fccc-4c7e-8e18-21d4afc76c55/exporter/0.log"
Oct 31 08:14:43.832183 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:43.832150    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-98qs2_25eb80fc-fccc-4c7e-8e18-21d4afc76c55/extractor/0.log"
Oct 31 08:14:44.273744 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:44.273705    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_periodic-gathering-664rw-prslb_bfe41bf6-ece6-425f-a0d4-04da4159aee9/insights-gathering/0.log"
Oct 31 08:14:45.756584 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:45.756550    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-848cd468bf6xwgj_c466db13-469b-488f-bf26-5229a2bcbb49/istio-proxy/0.log"
Oct 31 08:14:47.338059 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.338027    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5_61c6b83e-0379-440f-a69e-05b0d988b9a1/istio-proxy/0.log"
Oct 31 08:14:47.351482 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.351451    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6476fc869f-j728c_e3574328-5b1f-4a37-b939-8501022f9972/manager/0.log"
Oct 31 08:14:47.353386 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.353361    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6476fc869f-j728c_e3574328-5b1f-4a37-b939-8501022f9972/manager/1.log"
Oct 31 08:14:47.443607 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.443577    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-6476fc869f-j728c_e3574328-5b1f-4a37-b939-8501022f9972/copy-manifests/0.log"
Oct 31 08:14:47.528461 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.528432    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79b9f58c8f-wd2zk_4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/router/0.log"
Oct 31 08:14:47.547010 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.546959    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/odh-model-controller-769875db56-cp4r2"]
Oct 31 08:14:47.547230 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.547199    5039 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/odh-model-controller-769875db56-cp4r2" podUID="a357159f-963c-45e8-bde4-7b2aab5a158e" containerName="manager" containerID="cri-o://296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac" gracePeriod=10
Oct 31 08:14:47.828681 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.828651    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 08:14:47.861287 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.861254    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-metrics-certs\") pod \"a357159f-963c-45e8-bde4-7b2aab5a158e\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") "
Oct 31 08:14:47.861460 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.861304    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a357159f-963c-45e8-bde4-7b2aab5a158e-kube-api-access-7vjwp\" (UniqueName: \"kubernetes.io/projected/a357159f-963c-45e8-bde4-7b2aab5a158e-kube-api-access-7vjwp\") pod \"a357159f-963c-45e8-bde4-7b2aab5a158e\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") "
Oct 31 08:14:47.863385 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.863354    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-metrics-certs" pod "a357159f-963c-45e8-bde4-7b2aab5a158e" (UID: "a357159f-963c-45e8-bde4-7b2aab5a158e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:14:47.863496 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.863471    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a357159f-963c-45e8-bde4-7b2aab5a158e-kube-api-access-7vjwp" pod "a357159f-963c-45e8-bde4-7b2aab5a158e" (UID: "a357159f-963c-45e8-bde4-7b2aab5a158e"). InnerVolumeSpecName "kube-api-access-7vjwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 08:14:47.961874 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.961842    5039 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-cert\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-cert\") pod \"a357159f-963c-45e8-bde4-7b2aab5a158e\" (UID: \"a357159f-963c-45e8-bde4-7b2aab5a158e\") "
Oct 31 08:14:47.962160 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.962071    5039 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-metrics-certs\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:14:47.962160 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.962085    5039 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vjwp\" (UniqueName: \"kubernetes.io/projected/a357159f-963c-45e8-bde4-7b2aab5a158e-kube-api-access-7vjwp\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:14:47.964035 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:47.964008    5039 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-cert" pod "a357159f-963c-45e8-bde4-7b2aab5a158e" (UID: "a357159f-963c-45e8-bde4-7b2aab5a158e"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 08:14:48.015298 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.015263    5039 generic.go:356] "Generic (PLEG): container finished" podID="a357159f-963c-45e8-bde4-7b2aab5a158e" containerID="296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac" exitCode=0
Oct 31 08:14:48.015492 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.015303    5039 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-cp4r2"
Oct 31 08:14:48.015492 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.015349    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-cp4r2" event={"ID":"a357159f-963c-45e8-bde4-7b2aab5a158e","Type":"ContainerDied","Data":"296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac"}
Oct 31 08:14:48.015492 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.015402    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-cp4r2" event={"ID":"a357159f-963c-45e8-bde4-7b2aab5a158e","Type":"ContainerDied","Data":"f1d2bdcdec0a3ac23857d9f72d7f6dd36f7b20ee8ee499be41fca09ec2522ad8"}
Oct 31 08:14:48.015492 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.015428    5039 scope.go:122] "RemoveContainer" containerID="296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac"
Oct 31 08:14:48.029323 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.029020    5039 scope.go:122] "RemoveContainer" containerID="296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac"
Oct 31 08:14:48.029688 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:14:48.029667    5039 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac\": container with ID starting with 296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac not found: ID does not exist" containerID="296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac"
Oct 31 08:14:48.029793 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.029695    5039 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac"} err="failed to get container status \"296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac\": rpc error: code = NotFound desc = could not find container \"296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac\": container with ID starting with 296033d9fd2a60df5b903bac4afffd0167317cc3a532f4de73f6a4a5929015ac not found: ID does not exist"
Oct 31 08:14:48.063198 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.063165    5039 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a357159f-963c-45e8-bde4-7b2aab5a158e-cert\") on node \"ip-10-0-128-20.ec2.internal\" DevicePath \"\""
Oct 31 08:14:48.064290 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.064265    5039 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/odh-model-controller-769875db56-cp4r2"]
Oct 31 08:14:48.067407 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:48.067378    5039 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/odh-model-controller-769875db56-cp4r2"]
Oct 31 08:14:49.615306 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:49.615271    5039 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a357159f-963c-45e8-bde4-7b2aab5a158e" path="/var/lib/kubelet/pods/a357159f-963c-45e8-bde4-7b2aab5a158e/volumes"
Oct 31 08:14:51.035303 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:51.035268    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-7vcs5_85f328eb-ec63-43e1-b042-c8802531e222/manager/0.log"
Oct 31 08:14:51.444738 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:51.444644    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-82fjs_d7fa6638-6657-4a9c-8ffe-d0b933d2382b/manager/0.log"
Oct 31 08:14:51.750018 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:51.749990    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-khttk_7ab4eb59-90ae-4d88-98c8-06cb22a6cc66/server/0.log"
Oct 31 08:14:58.078134 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.078098    5039 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-778m9"]
Oct 31 08:14:58.079080 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.079051    5039 cpu_manager.go:414] "containerMap: removing container" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy"
Oct 31 08:14:58.079080 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.079075    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7942b45d-8533-4089-a961-751c59ba0591" containerName="istio-proxy"
Oct 31 08:14:58.079231 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.079100    5039 cpu_manager.go:414] "containerMap: removing container" podUID="a357159f-963c-45e8-bde4-7b2aab5a158e" containerName="manager"
Oct 31 08:14:58.079231 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.079105    5039 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a357159f-963c-45e8-bde4-7b2aab5a158e" containerName="manager"
Oct 31 08:14:58.079231 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.079179    5039 memory_manager.go:365] "RemoveStaleState removing state" podUID="a357159f-963c-45e8-bde4-7b2aab5a158e" containerName="manager"
Oct 31 08:14:58.084349 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.084327    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.100381 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.100352    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-778m9"]
Oct 31 08:14:58.109686 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.109651    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 31 08:14:58.113461 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.113438    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-5z29g\""
Oct 31 08:14:58.113540 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.113452    5039 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 31 08:14:58.164245 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.164206    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f291181-1404-41a5-b81b-54e198237f05-metrics-certs\") pod \"odh-model-controller-769875db56-778m9\" (UID: \"9f291181-1404-41a5-b81b-54e198237f05\") " pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.164452 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.164260    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f291181-1404-41a5-b81b-54e198237f05-cert\") pod \"odh-model-controller-769875db56-778m9\" (UID: \"9f291181-1404-41a5-b81b-54e198237f05\") " pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.164522 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.164442    5039 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qtqz\" (UniqueName: \"kubernetes.io/projected/9f291181-1404-41a5-b81b-54e198237f05-kube-api-access-9qtqz\") pod \"odh-model-controller-769875db56-778m9\" (UID: \"9f291181-1404-41a5-b81b-54e198237f05\") " pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.265259 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.265216    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f291181-1404-41a5-b81b-54e198237f05-metrics-certs\") pod \"odh-model-controller-769875db56-778m9\" (UID: \"9f291181-1404-41a5-b81b-54e198237f05\") " pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.265486 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.265277    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f291181-1404-41a5-b81b-54e198237f05-cert\") pod \"odh-model-controller-769875db56-778m9\" (UID: \"9f291181-1404-41a5-b81b-54e198237f05\") " pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.265486 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.265365    5039 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qtqz\" (UniqueName: \"kubernetes.io/projected/9f291181-1404-41a5-b81b-54e198237f05-kube-api-access-9qtqz\") pod \"odh-model-controller-769875db56-778m9\" (UID: \"9f291181-1404-41a5-b81b-54e198237f05\") " pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.267815 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.267775    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f291181-1404-41a5-b81b-54e198237f05-metrics-certs\") pod \"odh-model-controller-769875db56-778m9\" (UID: \"9f291181-1404-41a5-b81b-54e198237f05\") " pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.267932 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.267857    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f291181-1404-41a5-b81b-54e198237f05-cert\") pod \"odh-model-controller-769875db56-778m9\" (UID: \"9f291181-1404-41a5-b81b-54e198237f05\") " pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.283805 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.283770    5039 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qtqz\" (UniqueName: \"kubernetes.io/projected/9f291181-1404-41a5-b81b-54e198237f05-kube-api-access-9qtqz\") pod \"odh-model-controller-769875db56-778m9\" (UID: \"9f291181-1404-41a5-b81b-54e198237f05\") " pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.397144 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.397045    5039 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:14:58.696106 ip-10-0-128-20 kubenswrapper[5039]: E1031 08:14:58.695968    5039 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-98qs2" containerName="extractor"
Oct 31 08:14:58.696925 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.696881    5039 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-778m9"]
Oct 31 08:14:58.700852 ip-10-0-128-20 kubenswrapper[5039]: W1031 08:14:58.700826    5039 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f291181_1404_41a5_b81b_54e198237f05.slice/crio-9e94138c330e008a212dfee0e08f9e42bb21823f3a404335675c8e901c2ba993 WatchSource:0}: Error finding container 9e94138c330e008a212dfee0e08f9e42bb21823f3a404335675c8e901c2ba993: Status 404 returned error can't find the container with id 9e94138c330e008a212dfee0e08f9e42bb21823f3a404335675c8e901c2ba993
Oct 31 08:14:58.702989 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:58.702973    5039 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 08:14:59.077774 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:14:59.077734    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-778m9" event={"ID":"9f291181-1404-41a5-b81b-54e198237f05","Type":"ContainerStarted","Data":"9e94138c330e008a212dfee0e08f9e42bb21823f3a404335675c8e901c2ba993"}
Oct 31 08:15:00.084682 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:00.084640    5039 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-778m9" event={"ID":"9f291181-1404-41a5-b81b-54e198237f05","Type":"ContainerStarted","Data":"62788177e1653f97245a7640170d0001c9e542ac94e2a8ce3413eac42f6cff53"}
Oct 31 08:15:00.085250 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:00.084725    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:15:00.114986 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:00.114954    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-hdrmp_6330753d-1f92-46d9-a1ff-70262d02c414/migrator/0.log"
Oct 31 08:15:00.122579 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:00.122530    5039 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-778m9" podStartSLOduration=1.725346056 podStartE2EDuration="2.122518358s" totalImagesPullingTime="397.172302ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 08:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 08:15:00.122171288 +0000 UTC m=+2814.651365962" watchObservedRunningTime="2026-10-31 08:15:00.122518358 +0000 UTC m=+2814.651713031"
Oct 31 08:15:00.226505 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:00.226467    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-vx9p9_aec5e525-a7f4-460d-aceb-f8412e0c3b2b/migrator/0.log"
Oct 31 08:15:00.970313 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:00.970278    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-dtncg_71156071-2868-4bea-8ba9-20f9e073d996/kube-storage-version-migrator-operator/1.log"
Oct 31 08:15:00.971276 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:00.971252    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7d4bc45dd6-dtncg_71156071-2868-4bea-8ba9-20f9e073d996/kube-storage-version-migrator-operator/0.log"
Oct 31 08:15:02.940024 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:02.939992    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ktj5_508a0686-e4c7-472a-b608-d270a7dbce3d/kube-multus-additional-cni-plugins/0.log"
Oct 31 08:15:03.045414 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:03.045382    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ktj5_508a0686-e4c7-472a-b608-d270a7dbce3d/egress-router-binary-copy/0.log"
Oct 31 08:15:03.150051 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:03.150023    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ktj5_508a0686-e4c7-472a-b608-d270a7dbce3d/cni-plugins/0.log"
Oct 31 08:15:03.256318 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:03.256285    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ktj5_508a0686-e4c7-472a-b608-d270a7dbce3d/bond-cni-plugin/0.log"
Oct 31 08:15:03.364452 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:03.364425    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ktj5_508a0686-e4c7-472a-b608-d270a7dbce3d/routeoverride-cni/0.log"
Oct 31 08:15:03.470377 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:03.470348    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ktj5_508a0686-e4c7-472a-b608-d270a7dbce3d/whereabouts-cni-bincopy/0.log"
Oct 31 08:15:03.575796 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:03.575718    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6ktj5_508a0686-e4c7-472a-b608-d270a7dbce3d/whereabouts-cni/0.log"
Oct 31 08:15:05.210474 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:05.210435    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-j9f7v_06e7dac1-d91c-4928-bbca-a4d1535e2170/kube-multus/0.log"
Oct 31 08:15:05.425608 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:05.425571    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fkcpf_a2320145-3aab-44be-a1c2-7912c2498c30/network-metrics-daemon/0.log"
Oct 31 08:15:05.525930 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:05.525839    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fkcpf_a2320145-3aab-44be-a1c2-7912c2498c30/kube-rbac-proxy/0.log"
Oct 31 08:15:08.488325 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:08.488293    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqq5l_2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/ovn-controller/0.log"
Oct 31 08:15:08.592974 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:08.592940    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqq5l_2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/ovn-acl-logging/0.log"
Oct 31 08:15:08.698410 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:08.698377    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqq5l_2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/kube-rbac-proxy-node/0.log"
Oct 31 08:15:08.802851 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:08.802765    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqq5l_2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/kube-rbac-proxy-ovn-metrics/0.log"
Oct 31 08:15:08.906226 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:08.906197    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqq5l_2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/northd/0.log"
Oct 31 08:15:09.009513 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:09.009487    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqq5l_2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/nbdb/0.log"
Oct 31 08:15:09.114944 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:09.114806    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqq5l_2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/sbdb/0.log"
Oct 31 08:15:09.273213 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:09.273175    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kqq5l_2abc95d3-4c67-4a79-a0c2-5cdb7d2fd265/ovnkube-controller/0.log"
Oct 31 08:15:09.977496 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:09.977466    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-848cd468bf6xwgj_c466db13-469b-488f-bf26-5229a2bcbb49/istio-proxy/0.log"
Oct 31 08:15:11.093639 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:11.093607    5039 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-778m9"
Oct 31 08:15:11.621595 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:11.621563    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-fdb9847-6mbr5_61c6b83e-0379-440f-a69e-05b0d988b9a1/istio-proxy/0.log"
Oct 31 08:15:11.803565 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:11.803539    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-79b9f58c8f-wd2zk_4118a0cf-82b9-4bf6-a953-3af32ca0b5f4/router/0.log"
Oct 31 08:15:12.545556 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:12.545521    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-6f78d59f99-clcqg_9a46a25a-59fe-4cd2-8566-4203c84b5175/check-endpoints/0.log"
Oct 31 08:15:12.764037 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:12.763999    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mtrsf_647db033-e901-4100-b8a0-a60948730917/network-check-target-container/0.log"
Oct 31 08:15:15.355291 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:15.355262    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-jm95s_4820d461-a6e0-49fe-a57c-dbff7bc255f8/iptables-alerter/0.log"
Oct 31 08:15:17.099740 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:17.099664    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-xmjdj_29654c5b-afac-4935-b729-3e5b5c8adf50/tuned/0.log"
Oct 31 08:15:21.061435 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:21.061396    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6ddb6c8b94-nl4vc_5a3e7931-f6a9-419d-8cce-5c884e627036/cluster-samples-operator/0.log"
Oct 31 08:15:21.171948 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:21.171902    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6ddb6c8b94-nl4vc_5a3e7931-f6a9-419d-8cce-5c884e627036/cluster-samples-operator-watch/0.log"
Oct 31 08:15:23.003444 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:23.003412    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-544d749c8c-mbxx9_6b351b59-c90b-42cb-87b1-228f83da0488/service-ca-operator/1.log"
Oct 31 08:15:23.004471 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:23.004449    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-544d749c8c-mbxx9_6b351b59-c90b-42cb-87b1-228f83da0488/service-ca-operator/0.log"
Oct 31 08:15:23.780381 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:23.780351    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-5fffc97bdf-6ggm8_d8753ed2-8968-47dc-aae5-6abc034f7435/service-ca-controller/0.log"
Oct 31 08:15:25.293434 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:25.293405    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hfnms_513eea23-470d-4236-ae17-1666a54ce63f/csi-driver/0.log"
Oct 31 08:15:25.397552 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:25.397507    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hfnms_513eea23-470d-4236-ae17-1666a54ce63f/csi-node-driver-registrar/0.log"
Oct 31 08:15:25.501949 ip-10-0-128-20 kubenswrapper[5039]: I1031 08:15:25.501909    5039 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-hfnms_513eea23-470d-4236-ae17-1666a54ce63f/csi-liveness-probe/0.log"